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ABSTRACT 


The  purpose  of  this  study  was  to  obtain  information  for  the 
prediction  of  relative  success  in  the  N.A.I.T.  three  year  Electronics 
program,  to  provide  some  descriptive  statistics  as  to  the  nature  of 
the  students  who  entered  the  program  in  1965  and  1966  with  respect 
to  some  aptitude  and  intelligence  measures,  grade  nine  and  high  school 
academic  achievement,  and  to  provide  some  information  as  to  the 
stability  of  relative  performance  over  the  length  of  the  program. 

The  samples  included  all  those  students  who  entered  the  three 
year  Electronics  program  in  1965  and  in  1966,  who  did  not  withdraw 
for  reasons  other  than  poor  achievement,  and  for  whom  complete  pred¬ 
ictor  data  was  available.  An  attempt  was  made  to  develop  predictor 
combinations  for  the  total  group  including  Alberta  non-adult  students, 
adult  students  and  students  from  outside  Alberta,  on  the  basis  of 
D.A.T.  scores.  An  attempt  was  also  made  to  develop  predictor  comb¬ 
inations  for  Alberta  non-adult  students  on  the  basis  of  grades  9*  10 
and  11  scores  and  on  the  basis  of  D.A.T.  scores. 

The  criterion  scores  were  T  scores  based  on  rank  in  class.  Rank 
in  class  was  determined  on  the  basis  of  weighted  average  in  each  of  the 
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three  years  of  the  program,  and  for  students  who  did  not  complete  the 
year  under  consideration,  on  the  basis  of  length  of  time  in  the  pro¬ 
gram.  Students  who  withdrew  during  the  same  quarter  of  studies  were 
ranked  according  to  weighted  average  in  their  last  complete  quarter. 

Means,  standard  deviations  and  ranges  of  predictor  variables  were 
determined  and  tabulated.  Zero  order  correlations  between  all  variables 
were  determined  and  tabulated.  A  stepwise  multiple  linear  regression 
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procedure  was  used  to  determine  regression  equations  on  the  basis  of 
the  data  from  the  samples  which  entered  the  program  in  1965 .  The 
regression  equations  were  cross  validated  on  the  data  from  the  samples 
which  entered  the  program  in  1966. 

For  Alberta  non-adult  students,  a  number  of  variables  were 
found  to  be  consistently  significant  predictors  of  relative  success 
to  the  ends  of  each  of  the  three  years  of  the  N. A.I.T.  Electronics 
program  for  each  of  two  independent  samples.  These  predictors  were 
high  school  Math-Science  average ,  a  regression  combination  of  high 
school  Science  average  and  D.A.T.  Numerical  Ability ,  and  high  school 
academic  average0  High  school  Math-Science  average  was  selected  as 
the  optimum  predictor  of  relative  success  over  the  length  of  the 
program  and  expectancy  tables  were  constructed  based  on  that  predictor. 

No  consistently  significant  predictors  were  found  for  samples  which 
included  adult  and  non-Alberta  students. 

The  Alberta  non-adult  students  were  found  to  be  concentrated 
in  the  middle  range  of  high  school  academic  achievement. 

The  samples  were  found  to  have  high  correlations  between  relative 

i 

success  scores  to  the  ends  of  each  of  the  three  years  of  the  Electronics 
program,  with  the  samples  including  adult  or  non  Alberta  students  having 
higher  criterion  intercorrelations  than  the  sample  including  only  Alberta 
ribn- adult  students 0 
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CHAPTER  I 


THE  PROBLEM  IN  PERSPECTIVE 

I.  INTRODUCTION 

The  problem  of  predicting  success  in  post  secondary  programs 
has  probably  received  as  much  attention  as  any  other  single  problem 
in  education.  Reasons  for  the  intense  interest  in  the  prediction 
of  academic  success  are  easily  determined,  for  at  the  completion  of 
secondary  schooling,  the  student  stands  at  one  of  the  major  cross¬ 
roads  of  life.  He  may  seek  immediate  employment,  he  may  choose  to 
go  to  one  of  a  number  of  colleges  and  register  in  his  choice  from 
a  large  number  of  specialties,  or  he  may  choose  from  among  a  number 
of  other  post -second ary  institutions  which  offer  a  myriad  of 
programs . 

The  student  may  base  his  choice  on  the  information  he  has  at 
hand,  on  what  his  friends  are  doing,  on  what  his  parents  wish  him  to 
do,  or  on  the  advice  of  a  counselor.  The  possession  of  relevant 
information  is  a  necessary  pre-condition  for  good  decision  making. 
The  prediction  of  academic  performance  cannot,  at  present  guarantee 
that  correct  determinations  can  be  made  consistently,  but  the 
greater  the  degree  of  relevant  information  possessed  by  the  student, 
the  greater  the  potential  for  good  decision  making. 

The  importance  of  this  decision  is  nowhere  more  aptly  stated 


than  by  Bloom: 
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If  he  chooses  a  course,  a  college,  and  a  curriculum 
that  fulfill  his  needs  and  challenge  but  do  not  over¬ 
tax  his  capabilities  he  is  liable  to  gain  much  from 
higher  education.  If  he  chooses  a  college  and  pro¬ 
gram  with  requirements  far  above  his  possibility  of 
attainment,  he  will  suffer  the  frustration  and  loss 
of  time  and  opportunity  consequent  on  failure  •  •  . 
The  matter  of  choice  is  not  just  the  student’s  con¬ 
cern  .  .  .  colleges  that  accept  students  who  fail 
suffer  great  losses  in  utilization  of  faculty  and 
other  resources. 


II.  THE  PROBLEM 

Statement  of  the  Problem 

The  purpose  of  this  study  was: 

1.  To  gather  information  that  could  be  used  as  a  partial 
basis  for  predicting  a  student’s  relative  success  in 
the  three  year  Electronics  program  offered  at  the 
Northern  Alberta  Institute  of  Technology  (hereinafter 
referred  to  as  N.A.I.T.). 

2.  To  gather  information  as  to  the  stability  of  relative 
performance  of  students  in  the  N. A.I.T.  three  year 
Electronics  program. 

3.  To  gather  information  on  the  previous  achievement 
levels  and  ability  levels  of  students  who  enter  the 


Benjamin  Samuel  Bloom  and  Frank  R.  Peters.  The  Use  of 
Academic  Prediction  Scales  for  Counselling  and  Selecting  College 
Entrants.  (New  York:  Free  Press  of  Glenco,  1961),  pp.  7-8. 
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three  year  Electronics  program 
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Specifically,  the  questions  this  study  proposed  to  answer 

were : 

10  How  well  do  the  average  grades  in  each  of  the  combinations 

2 

listed  below  predict  relative  success  to  the  ends  of  each  of 
the  years  of  N.A.I.T.  three  year  Electronics  program? 

a)  Mathematics  10  or  12  and  Mathematics  20  or  22 

b)  Science  10  and  Science  20 

c)  English  10  and  English  20 

d)  the  mean  of  the  above  listed  scores 

2.  How  well  do  the  scores  on  each  of  the  grade  IX  Alberta 
Departmental  Examinations  and  the  mean  of  the  scores 
(excepting  S.C.A.To)  on  the  Alberta.  Departmental  Examinations 
predict  relative  success  to  the  end  of  the  three  years  of 
the  N.A.I.T.  Electronics  program? 

3o  How  well  do  each  of  the  D.A„T0  subtest  scores  predict 
relative  success  to  the  ends  of  each  of  the  years  of 
the  N.A0I.T.  three  year  Electronics  program? 

4o  How  well  do  the  best  combinations  of  the  predictors 
listed  in  questions  1  to  3j  as  determined  by  stepwise 
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multiple  linear  regression,  predict  relative  success 
to  the  ends  of  each  of  the  years  of  the  N.A.I.T. 
three  year  Electronics  program? 

5.  What  are  the  correlations  between  relative  success  to 
the  ends  of  each  of  the  three  years  of  the  N.A.I.T. 
three  year  Electronics  program,  for  those  students 
who  complete  the  three  years  of  the  program? 

Hypotheses 
Hypothesis  1 

There  is  no  significant  correlation  between  the  average 
grades  in  each  of:  Mathematics  10  or  12  and  Mathematics  20  or  22, 
Science  10  and  Science  20,  English  10  and  English  20,  Social 
Studies  10  and  Social  Studies  20,  the  mean  of  the  above  listed 
mathematics  and  science  grades  and: 

la.  relative  success  to  the  end  of  year  A  of  the  N.A.I.T. 
three  year  Electronics  program. 

lb.  relative  success  to  the  end  of  year  B  of  the  N.A.I.T. 
three  year  Electronics  program. 

lc.  relative  success  to  the  end  of  year  C  of  the  N.A.I.T. 
three  year  Electronics  program. 

Hypothesis  2 

There  is  no  significant  correlation  between  grades  in  each  of: 
Heading  IX,  Literature  IX,  Language  IX,  Social  Studies  IX, 
•Mathematics  IX,  Science  IX,  S.C.A.T.  Total,  S.C.A.T.  Verbal, 
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S.C.A.T.  Quantitative,  and: 

2a.  relative  success  to  the  end  of  year  A  of  the  N.A.I.T. 

three  year  Electronics  program. 

2b.  relative  success  to  the  end  of  year  B  of  the  N.A.I.T. 

three  year  Electronics  program. 

2c.  relative  success  to  the  end  of  year  C  of  the  N.A.I.T. 
three  year  Electronics  program. 

Hypothesis  3 

There  is  no  significant  correlation  between  the  mean  of 
grades  in  Reading  IX,  Literature  IX,  Language  IX,  Science  IX, 
Mathematics  IX,  Social  Studies  IX,  the  mean  of  all  the  high  school 
grades  listed  in  hypothesis  1,  and; 

3a.  relative  success  to  the  end  of  year  A  of  the  N.A.I.T. 

three  year  Electronics  program, 

3b.  relative  success  to  the  end  of  year  B  of  the  N.A.I.T. 

three  year  Electronics  program. 

3c.  relative  success  to  the  end  of  year  C  of  the  N.A.I.T. 

three  year  Electronics  program. 

Hypothesis  1  to  3  were  tested  for  significance  at  the  .05 

3 

level  of  confidence  for  samples  3  and  4« 

Hypothesis  4 

There  is  no  significant  correlation  between  the  scores  in 
each  of  the  D.A.T.  subtests;  Verbal,  Numerical  Ability,  Abstract 
Reasoning,  Clerical  Speed  and  Accuracy,  Spatial  Relations,  Mech¬ 
anical  Reasoning,  Language  Usage  -  Spelling,  Language  Usage  -  Sent¬ 
ences,  Verbal  Reasoning  and  Numerical  Ability  and  each  of: 

3 

For  definition  of  samples  see  pages  12  and  13  of  this  study. 
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4a.  relative  success  to  the  end  of  year  A  of  the  N.A.I.T. 
three  year  Electronics  program. 

4b.  relative  success  to  the  end  of  year  B  of  the  N.A.I.T. 
three  year  Electronics  program. 

4c«  relative  success  to  the  end  of  year  C  of  the  N.A.I.T. 
three  year  Electronics  program. 

Hypothesis  5 

There  is  no  significant  correlation  between: 

5a.  relative  success  to  the  end  of  year  A  of  the  N.A.I.T. 
three  year  Electronics  program  and  relative  success  to 
the  end  of  year  B  of  the  N.A.I.T.  three  year  Electronics 
program. 

5b.  relative  success  to  the  end  of  year  A  of  the  N.A.I.T. 
three  year  Electronics  program  and  relative  success 
to  the  end  of  year  C  of  the  N.A.I.T.  three  year  Elec-" 
tronics  program. 

5c.  relative  success  to  the  end  of  year  B  of  the  N.A.I.T. 
three  year  Electronics  program  and  relative  success  to 
the  end  of  year  C  of  the  N.A.I.T.  three  year  Electronics 
program. 

Hypothesis  5  was  tested  for  significance  at  the  .05  level  of 
confidence  for  each  of  samples  1,  2,  3  ana  4,  and  for  each  of 
groups^  la,  2a,  3a  and  4a. 

^For  definition  of  groups  la  -  4a  see  page  13  of  this  study. 
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III.  SIGNIFICANCE  OF  THE  STUDY 

Thjs  study  provides  cross-validated  estimates  of  the  val¬ 
idity  of  grades  in  selected  secondary  school  subjects  and  aptitude 
tests  as  predictors  of  relative  success  in  the  N.A.I.T.  three  year 
Electronics  program.  It  has  been  shown  that  grades  in  secondary 
school  are  effective  predictors  of  success  in  the  freshman  year 
of  college.  However,  very  little  work  has  been  done  to  date 
regarding  the  predictive  validity  of  high  school  grades  for  tech¬ 
nology  programs.  This  report  rectifies  this  omission  and  provides 

information  on  consistency  of  performance  over  the  length  of  the 

5 

program,  an  area  which  Lavin  points  up  as  one  requiring  further 
study. 

Descriptive  statistics  with  respect  to  the  ability  scores 
and  the  nature  of  secondary  school  performance  of  students  who  enter 
the  program  are  also  provided  by  this  study. 

For  the  purposes  of  prediction  of  success  over  the  length 
of  the  program  this  study  takes  into  account  data,  for  those  students 
who  dropped  out  as  well  as  for  those  who  completed  the  program. 

IV.  SETTING  FOR  THE  STUDY 

The  Northern  Alberta  Institute  of  Technology  has  been  offering 
trade  and  para-professional  training  to  an  ever  increasing  number  of 
Alberta's  youth  since  operations  began  in  1962.  Total  enrollment  in 

5 

David  E.  Lavin.  The  Prediction  of  Academic  Performance :  A 
Theoret i  cal  Analysis  and  Review  of  Research.  (New  York:  Russell  Sage 
Foundation,  1965 )»  p.  46. 


. ,  -  l  .  ‘  i  tt  i‘  ■ 


' 


8. 


the  1968-69  term  was  of  the  order  of  10,000  full  time  students. 

The  present  study  was  concerned  with  the  three  year  Elec¬ 
tronics  program  offered  at  the  institution.  The  requirements  for 
entry  into  the  program  in  1965  and  1966  were  67  high  school  credits 
and  a  B  or  better  in  Mathematics  20  or  22,  Many  of  the  students 
enter  the  program  with  credit  in  grade  XII  courses.  However,  those 
with  a  high  school  diploma  and  a  B  or  better  standing  in  Mathematics 
30  or  32  and  Physics  30  or  32  could  enter  a  two  year  electronics 
program,  rather  than  the  three  year  program.  A  two-year  program 
in  electronics  is  also  available  for  those  who  have  completed  a 
high  school  vocational  program  in  electronics. 

The  three  year  program  consists  of  three  eight-month  sessions, 
years  A,  B,  and  C  in  that  order.  Each  year  is  broken  down  into 
three  quarters,  such  that  the  total  program  consists  of  nine  quarters 
each  of  which  includes  five  to  eight  courses.  Year  A  technology 
is  a  common  year  for  students  who  wish  to  go  into  the  Electronics 
program  in  year  B,  and  for  those  who  wish  to  go  into  the  Materials 
Technology  or  Exploration  Technology  programs  in  year  B. 

There  is  no  ’hard-and-fast’  rule  regarding  the  number  of 
courses  a  student  may  fail  before  being  asked  to  repeat  a  quarter. 

If  a  student  obtains  a  final  mark  of  less  than  50 %  in  more  than 
one  course  in  a  quarter,  or  a  weighted  average  of  less  than  50%, 
his  performance  is  reviewed  and  he  may  be  required  to  withdraw  or 
repeat  a  quarter. 


_ 
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V.  CONTEXT  OF  THE  STUDY 

This  study  is  part  of  PROJECT  NAIT  under  the  direction  of 
Dr.  D.  W.  R.  Wilson  of  the  Faculty  of  Education,  University  of 
Alberta.  Under  investigation  in  this  project  are  the  structures 
of  selected  courses  in  the  N.A.I.T.  Electronics  program,  their 
relationships  to  secondary  school  academic  disciplines  and  ability 
factors,  and  the  way  in  which  these  courses  may  be  organized  in 
a  manner  most  consistent  with  the  structure  of  the  disciplines 

i 

involved • 

VI.  LIMITATIONS  OF  THE  STUDY 

1.  Some  of  the  students  who  entered  the  program  in  1965  and 
in  1966  were  not  included  in  the  sample  because  of  lack 
of  complete  predictor  data  for  them.  For  example,  some 
students  were  absent  when  the  D.A.T.  tests  were  written. 

2.  The  fact  that  some  students  who  drop  out  return  later 
to  complete  the  program  was  not  taken  into  account. 

3.  Students  who  dropped  out  of  the  program  for  reasons 
other  than  poor  achievement,  as  defined  in  this  study, 
were  not  considered. 

4.  No  attempt  was  made  to  consider  factors  other  than  the 
predictors  and  criteria  listed  in  the  design  of  this 
study. 

5.  The  reliability  of  grade  10  and  11  marks,  and  marks  in 


. 
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courses  of  the  Electronics  program,  was  not  known. 

6.  The  effect  of  different  instructors  or  course  changes 
Y/as  not  considered, 

7*  Form  B  of  the  D.A.T.  was  administered  in  February,  1966, 

to  the  students  who  entered  the  program  in  1965,  while 

form  L  of  the  D.A.T.  was  administered  in  November,  1966 

to  those  who  entered  the  program  in  1966.  Though  the 

6 

two  D.A.T.  forms  correlate  quite  highly,  they  are  hot 
identical. 

VII.  DEFINITIONS  OF  TERMS 

Relative  Success 

Relative  success  shall  be  defined  as  a  T  score  calculated  on 
the  basis  of  percentile  rank  in  class.  Rank  in  class  during  a  given 
year  was  determined  on  the  basis  of  final  grades  in  courses  taken 
during  that  year  of  the  program  for  students  who  did  not  drop  out  of 
the  program  before  the  end  of  that  year.  Students  who  did  not  com¬ 
plete  the  year  were  ranked  in  order,  below  those  who  did,  on  the 
basis  of  the  number  of  quarters  of  work  they  completed  and  on  the 
basis  of  their  weighted  average  in  their  last  quarter  in  the  program. 


Bennett,  George  K. ,  Seashore,  Harold  G. ,  and  Wessman, 
Alexander  G.  Differential  Aptitude  Tests,  Manual,  4th  Ed,,  The 
Psychological  Corporation,  New  York:  1966. 
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For  example,  when  considering  relative  success  to  the  end 
of  year  B  (six  quarters),  all  students  who  completed  five  quarters 
of  work  were  ranked  in  order,  below  those  who  completed  six 
quarters  on  the  basis  of  their  weighted  averages  in  the  fifth 
quarter,  while  those  who  completed  four  quarters  were  ranked  below 
them,  etc© 

The  above  definition  of  relative  success  is  based  on  the 
assumptions  listed  below. 

1.  All  students  who  completed  any  part  of  the  program  have 
achieved  some  measure  of  success  in  it. 

2.  The  earlier  a  student  dropped  out  with  poor  achievement, 
the  less  successful  he  was  in  the  program. 

3.  A  student  who  obtained  a  certain  weighted  average  in  a 
given  year  or  a  given  quarter  of  the  program  had  achieved  a  larger 
measure  of  success  to  that  point  in  the  program  than  a  student  who 
had  obtained  a  lower  weighted  average  in  that  year  or  quarter  of  the 
program. 

4.  The  intervals  between  relative  success  ranks  are  equal 
in  magnitude. 

Weighted  Average 

The  weighted  average  is  the  sum  of  the  products  of  the  final 
marks  and  the  hours  of  instruction  in  courses  taken  in  a  given  year, 
divided  by  the  total  hours  of  instruction  in  that  year.  The  weighted • 
average  is  the  score  used  by  N.A.I.T.  for  ranking  students  in  a 
given  program. 
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Drop-Out  with  Poor  Achievement 

A  drop-out  with  poor  achievement  shall  be  defined  as  a 
student  who  dropped  out  of  the  program  and  received  a  final  grade 
of  less  than  50$  in  at  least  one  course  in  his  last  quarter,  or 
whose  weighted  average  in  his  last  quarter  was  less  than  55 
percent . 

Population 

The  population  shall  be  defined  as  those  students  who  meet 
the  admission  requirements  for  the  N.A.I.T.  three  year  Electronics 
program  and  who  have  applied  or  will  apply  for  admission  to  the 
program  in  the  period  1965  ~  1970. 

Alberta  Non-Adult  Student 

Alberta  non-adult  students  shall  be  defined  as  those 
members  of  the  population  who  received  their  high  school  training 
in  Alberta  and  who  had  written  their  Grade  IX  Department als  less 
than  six  years  before  entering  the  Electronics  program. 

Sample  1 

Sample  1  shall  be  defined  as  those  members  of  Sample  3  who 
were  Alberta  non-adult  students. 

Sample  2 

Sample  2  shall  be  defined  as  those  members  of  Sample  4  who 
were  Alberta  non-adult  students. 

Sample  3 

Sample  3  shall  be  defined  as  those  members  of  the  population 
who  registered  in  Year  A  of  the  N.A.I.T.  three  year  Electronics 


. 
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program  in  September,  1965  and  for  whom  the  following  conditions 
were  met : 

1*  those  for  whom  complete  predictor  data  was  available. 

2.  those  who  either  completed  the  program  or  were  drop-outs 
with  poor  achievement. 

3.  those  who  were  not  repeating  a  year  of  the  program. 

4.  those  who  remained  in  the  program  until  February 
of  Year  kj 

5.  those  for  whom  achievement  data  for  the  Electronics 
program  was  available  at  N.A.I.T. 

Sample  Ji 

Sample  4  shall  be  defined  as  those  students  who  registered 
in  Year  A  of  the  three  year  Electronics  program  at  N.A.I.T.  in 
September,  1966  and  for  whom  the  five  conditions  listed  for  Sample 
3  were  met. 

Groups  la ,  2a ,  3a  and  4a 

Groups  la,  2a,  3a  and  4a  shall  be  defined  as  those  members  of 
Sample  1,  Sample  2,  Sample  3  and  Sample  4  respectively,  who 
remained  in  the  Electronics  program  over  its  three  year  length. 

n 

D.A.T.  tests  were  written  in  February,  1966  by  those 
students  who  entered  the  program  in  September,  1965. 


- 
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REVIEW  OF  THE  LITERATURE 

This  study  is  concerned  with  the  prediction  of  success  over 
the  three  year  length  of  a  technology  program. 

The  literature  review  is  divided  into  three  sections.  First, 
a  review  is  presented  of  some  pertinent  literature  related  to 
prediction  problems  in  general.  The  second  section  consists  of  a 

i 

rev.iev/  of  the  literature  related  to  the  prediction  of  success  in 
technical  and  vocational  programs.  Because  the  major  portion  of 
literature  on  prediction  is  related  to  prediction  of  college  success, 
especially  freshman  success,  the  third  section  provides  a  review  of 
some  literature  related  to  the  prediction  of  school  and  college 
success. 

lo  LITERATURE  RELATED  TO  PREDICTION  OF 
ACADEMIC  PERFORMANCE  IN  GENERAL 

Bloom  and  Peters  suggest  that  the  sources  of  variation  in 
academic  performance  are:  errors  in  judgment  of  teachers  about  the 
quality  of  a  student's  achievement,  the  difference  among  students  in 
achievement  and  motivation,  and  the  difference  in  standards  from  school 
to  school.  They  suggest  that  the  errors  in  judgment  of  teachers  have 
been  grossly  overestimated  and  that  grade  averages  may  have  a  high 
reliability  if  appropriate  scaling  procedures  are  applied  to  remove 
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the  error  from  the  other  sources  of  variation.^' 

In  a  study  begun  in  1956,  Bloom  and  Peters  used  the  records 
of  some  25,000  students  who  graduated  from  the  126  participating 
schools  of  the  National  Registration  Office.  They  obtained  corre¬ 
lations  between  high  school  achievement,  aptitude  test  scores, 
achievement  test  scores,  and  college  achievement.  Some  of  their 
pertinent  findings  are  as  follows: 

1.  Average  correlation  between  school  and  college  grades 
is  about  -f,  0.50.^ 

20  Median  congelations  between  grade  averages  in  adjacent 
college  semesters  is  H-  .79,  median  correlation  between  grade 
averages  two  semesters  apart  is  H-  .72,  and  median  correlation  between 

'i 

grades  three  semesters  apart  is  +.66. 

3.  V/ithin  a  school  or  college,  academic  grades  and  aptitude 
scores  correlate  in  the  order  of  -f.  50^ 

4.  The  vast  majority  of  correlations  used  for  prediction  of 

5 

professional  or  graduate  schools  lie  between  H-  0.30  and  +  0.60. 

5.  When  aptitude  scores  and  high  school  grades  are  combined 

by  a  regression  method  and  the  scores  are  scaled  to  make  them  eoAu.i valent 
for  different  schools  and  colleges,  the  prediction  of  academic  success 

‘^Benjamin  Samuel  Bloom  and  Frank  R.  Peters,  The  Use  of  Academic 
Prediction  Scales  for  Counselling  and  Selecting  College  Entrants.  ( New 
York:  Free  Press  of  Glenco,  1961).  pp„  V-VI 


Ibid. , 

P° 

37 

3Ibid., 

P. 

38 

4 Ibid.  , 

p. 

159 

^  Ib  id . , 

P. 

31 
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can  be  improved  to  a  correlation  of  about  0.75.^ 

Reliability  of  first  year  college  grades  is  estimated  to  be 
in  the  order  of  -f  0.80,  which  represents  the  upper  limit  of  predic¬ 
tion  correlations  unless  the  reliability  of  college  grades  is  im¬ 
proved  . 6  7 * * 10 


Assessment  techniques,  which  take  into  account  sociological 
and  psychological  factors,  could  be  useful  for  prediction  purposes. 

g 

However,  large  scale  applications  have  not  yet  been  developed. 

9 

Lavin  reviewed  some  300  prediction  studies  published  between 
1958  and  1961.  A  summary  of  some  of  his  conclusions  pertinent  to 
this  .study  is  as  follows. 

Measures  of  ability  account  for  35  to  45  percent  of  the 
variation  in  academic  performance  in  high  school  and  college.^ 

A  large  proportion  of  the  variance  in  academic  achievement 
could  be  accounted  for  by  nonintellective  factors  such  as  personality 
factors,  sociological  factors,  and  the  interactions  between  them.^ 


6Ibid. ,  p.  151. 

7Ibid. ,  p.  131o 

BIbid. ,  p.  30. 

^David  E.  Lavin.  The  Prediction  of  Adacemic  Performance :  A 
Theoretical  Analysis  and  a  Review  of  Research,  (New  York:  Russell 
Sage  Foundation,  1965, ) 

10Ibid. ,  p.  59 

nibid.,  p.  166. 
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The  state  of  knowledge  with  regard  to  socioenvironmental 
and  psychological  factors  is  definitely  not  at  a  sufficiently 

definitive  level  to  be  used  for  decision  making  in  counselling, 
and  Lavin  expresses  some  doubt  as  to  whether  or  not  the  same  is 

IP 

true  for  intellective  factors. 

Studies  of  academic  performance  are  almost  exclusively 

static  rather  than  longitudinal,  in  design  (that  is,  they  employ 

criterion  measures  taken  at  only  one  point  in  time).  We  are 

therefore  relatively  ignorant  with  respect  to  consistency  of 

13 

performance  and  the  stability  of  predictions  over  time. 

Martin  ^  used  a  survey  technique  and  a  multivariate  analysis 
procedure  to  identify  sociological  factors  which  influenced  the 
amount  of  education  an  individual  had  obtained.  Among  the  signifi¬ 
cant  social  determinants  Martin  identified  were:  the  gross  disposable 
income  of  the  family,  the  number  of  siblings,  the  occupation  of  the 
father,  religion  of  the  family,  and  a  personality  measure  of  the 
father’s  need  for  achievement  and  his  attitude  toward  hard  work 
and  luck.^^ 

12Ibid.,  p.  12o 
^Ibido ,  p.  46 

^+David  Martin,  et  al. ,  Educational  Achievement,  It’s  Causes 
and  Effects.  A  Report  prepared  by  the  Survey  Research  Center  in 
co-operation  with  the  U.S.  Department  of  Health,  Education  and  Welfare, 
Office  of  Education,  Ann  Arbor:  1961,  Monograph  No.  23. 

15 Ibid. ,  p.  2. 
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Martin  concluded  that  parental  characteristics  have  a  power¬ 
ful  impact  on  the  amount  of  education  an  individual  acquires.  The 
amount  of  education  the  father  has  is  the  single  most  powerful 
social  determinant ,  while  the  amount  of  education  the  mother  and  the 
paternal  grandfather  have  are  also  important. ^ 

Martin  claimed  to  be  able  to  explain  28  to  41  percent  of 
the  variation  in  the  total  amount  of  education  individuals 

acquired,  on  the  basis  of  an  analysis  of  his  selected  sociological 

17 

determinants. 

This  sort  of  information  is  no  doubt  highly  valuable  for  long 
term  predictions  for  groups  as  a  whole.  However,  one  tends  to 
question  the  value  of  the  data  for  counselling  an  individual  with 
regard  to  his  chances  for  success  in  a  given  program.  It  seems 
doubtful  that  our  society  would  accept  the  legitimacy  of  an  individ¬ 
ual's  being  counselled  into  or  out  of  a  program  on  the  basis  of  a 
prediction  battery  which  includes  such  factors  as  his  religion  or 
the  amount  of  education  his  father  has.  ,  . 

By  the  early  1950' s,  the  use  of  combinations  of  predictors. 

to  form  a  prediction  battery  by  means  of  regression  procedures  was 

* 

quite  common.  Brogden,  carried  out  a  study  to  show  that: 

The  use  of  differential  predictors  will  provide  sub¬ 
stantial  increase  in  selective  efficiency  over  that 
obtained  with  a  single  predictor. ^ 


16 


Ibid. 
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'ibid. ,  p.  5 

1  o 

Hubert  E.  Brogden,  "Increased  Efficiency  Resulting  from 
Replacement  of  a  Single  Predictor  with  Several  Differential  Predictors," 
Educational  and  Psychological  Measurement ,  Vol.  67,  No.  3,  p.  185. 
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Bae  hypothesized  that  a  combination  of  predictors  which 
would  maximize  prediction  of  high  school  chemistry  scores  could 
be  selected  by  means  of  multiple  linear  regression  procedures, 
from  among  15  selected  subtests  of  the  D.A.T.,  Iowa  Chemistry 
Aptitude  Tests,  and  Science  Aptitude  Tests.  She  found  that  the 
combination  of  all  15  predictors  yielded  a  multiple  correlation 
(R  =  0.78)  which  was  not  significantly  better  than  that  yielded  by 
the  best  combination  of  4  predictors  as  selected  by  a  stepwise 
multiple  linear  regression  procedure,  (R  —  0.75,  N  —  117).  This 
combination  of  4  predictors  included  the  I.C.A.E.,  information  on 
Science  Test, the  D.A.T.  Verbal  Reasoning  Subtest,  the  D.A.T.  Numeric¬ 
al  Ability  Subtest,  and  the  Science  Aptitude  Examination,  Part  B; 
Reading  in  Science.  Her  conclusion  was  that  the  most  efficient 
predictors  for  high  school  chemistry  grades  fall  into  three  categor¬ 
ies:  general  intelligence,  background  experience  in  science  and 
mathematics,  and  reading  comprehension,  as  measured  by  selected 

subtests  of  the  D.A.T.  Iowa  Chemistry  Aptitude  Tests,  and  Science 

19 

Aptitude  Tests. 

Though  combinations  of  large  numbers  of  predictors  -often  re¬ 
sulted  in  very  high  correlations,  it  became  evident  that  the  corre¬ 
lation  coefficients  often  shrank  dismally  when  these  regression 
equations  were  applied  on  another  similar  group. 

Guilford  suggested  that  the  use  of  large  numbers  of  predictors 

Agnes  Y.  Bae,  "The  Prediction  of  the  Learning  of  Chemistry 
among  11th  Grade  Girls  Through  the  Use  of  Stepwise  and  Doolittle 
Techniques,"  Educational  and  Psychological  Measurement,"  Vol.  27,  No. 
4,  1967,  pp.  1131-1136. 
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in  regression  equations  has  little  value. 
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As  a  matter  of  experience  in  education  and  psychologi¬ 
cal  predictions,  it  has  been  a  common  finding  that  it 
rarely  pays  to  bring  into  a  multiple  prediction  situa¬ 
tion  more  than  four  or  five  independant  variables.  By 
the  time  that  this  many  are  combined,  they  have  fairly 
well  covered  what  any  additional  one  can  do  for  us. 

This  is  partly  a  consequence  of  the  fact  that  good 
human  qualities  tend  to  go  together,  (to  be  correlated) 
and  partly  that  our  predictive  indices  tend  to  remain 
in  the  same  area  of  abilities,  also  ignoring  personal¬ 
ity  factors,  physical  factors  and  external  circumstan¬ 
ces  . 

Cureton  explained  the  reasons  for  the  shrinkage  of  multiple 

regression  coefficients  when  regression  equations  are  applied  to 

another  group,  and  the  need  for  cross  validation,  as  follows : 

The  least  square  regression  weights  are  the  best  weights 
to  use  in  predicting  the  criterion  scores  of  the  valida¬ 
tion  sample  subjects.  Their  use  maximizes  the  multiple 
correlation  in  that  particular  sample.  It  does  so  by 
giving  optimal  weights  to  everything  which,  in  that 
sample,  will  contribute  to  prediction.  "Everything" 
includes,  however,  the  sampling  errors  in  the  valida¬ 
tion  sample  data.  Hence  the  least  squares  process 
over-fits;  it  fits  the  errors  as  well  as  the  systematic 
trends  in  data. 

Cross  validation  provides  solutions  to  some  of  the  re¬ 
sulting  problems.  In  particular,  it  answers  the  ques¬ 
tion,  "If  we  use  the  weights  determined  from  one  sample 
to  predict  criterion  scores  in  another  sample,  what 
will  be  the  aggregate  correlations,  in  this  second 
sample,  between  the  predictor  variable  so  weighted  and 
the  criterion?"  This  aggregate  correlation  is  almost 
always  appreciably  lower  than  the  multiple  correlation 
in  the  validation  sample,  and  it  is  necessarily  lower 
than  the  multiple  correlation  in  the  cross  validation 
*  sample. ^1 


Guilford,  Fundamental  Statistics  in  Psychology  and 
Education,  (New  York:  McGraw  Hill  Book  Co.  Inc.,  1950),  pp.  426-427. 

^Edward  E.  Cureton,  "Approximate  Linear  Restraints  and  Best 
Predictor  Weights,"  Educational  and  Psychological  Measurement,  Vol.  11, 
No.  1,  1951. 
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Mosier  also  stated  that,  if  the  combining  weights  of  a 

predictor  composite  are  determined  on  one  sample,  the  effectiveness 

of  the  composite  must  be  determined  on  another  independent  sample, 

22 

a  procedure  he  defines  as  cross-validation. 

Y/essman  and  Bennett  in  a  study  on  the  prediction  of  college 
grades,  used  the  three  subtests  of  the  College  Qualification  tests 
to  develop  a  regression  equation  and  then  applied  this  equation  to 
the  data  on  another  group  in  a  different  college.  They  found  that 
the  correlation  of  the  regression  equation  with  college  grades  in 
the  second  sample  shrank  to  the  point  where  it  was  not  a  signifi¬ 
cantly  better  predictor  than  the  simple  total  of  the  three  subtest 
scores.  They  explained  the  shrinkage  in  multiple  correlation  co¬ 
efficient  as  being  due  to  fitting  for  accidental  characteristics 

of  the  validation  group  and  due  to  the  fact  that  the  criteria  in 

23 

the  second  college  may  be  somewhat  different „ 

It  could  be  argued,  however,  that  the  reason  the  simple 
total  of  the  three  subtest  scores  worked  as  well  in  the  second  sam¬ 
ple  was  that  the  three  scores  happened  to  contribute  approximately 
equally  to  prediction  for  that  group. 


22 

Charles  I.  Mosier,  “Problems  and  Designs  of  Cross-Valida¬ 
tion,  “  Educational  and  Psychological  Measurement,  Vol.  II,  No.  1, 

1951,  pp.  5-11.  ' . '  .  ~~ . " 

23a.  e.  v/essman  and  G.  K.  Bennet,  “Multiple  Regression  vs. 

Simple  Addition  of  Scores  in  Prediction  of  College  Grades,"  Educational 
and  Psychological  Measurement,  Vol.  XIX,  No.  2,  1959,  pp.  243-6. 
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Wherry,  in  a  comparison  of  cross-validation  procedures  and 
statistical  inference  listed  the  following  as  the  more  important 
assumptions  needed  for  statistical  inference  to  be  drawn. 

1.  We  start  from  a  random  sample  of  a  specified  population. 

2.  We  are  going  to  predict  in  other  such  random  samples  to 
be  selected  in  the  future. 

3.  The  criterion  and  composite  scores  are  both  normally, 
distributed  in  the  population, 

4.  The  traits  selected  are  a  random  selection  of  all  possi¬ 
ble  traits. 

5.  Proper  correction  for  degrees  of  freedom  will  adequately 

2L. 

compensate  for  fitting  of  error. 

Wherry  states  that  if  all  these  assumptions  are  valid,  then 
it  may  be  concluded  that: 

a)  In  the  future  random  samples  selected,  composite  R 
will  have  a  mean  value  of  shrunken  R, 

b)  In  the  future  random  samples  selected,  the  betas 
will  all  have’  the  same  signs  as  the  original  sam¬ 
ple  although  not  necessarily  the  same  relative 
magnitudes. ^5 

Wherry  suggests  that  this  is  a  meager  return  for  a  large 
number  of  assumptions.  However,  he  expressed  dissatisfaction  with 
cross-validation  on  the  grounds  that  the  level  of  confidence  is  un- 


^Robert  I.  Wherry,  ’’Comparison  of  Cross-Validation  with 
Statistical  Inference  of  Betas  and  Multiple  R  from  A  Single  Sample, 
Educational  and  Psychological.  Measurement ,  Vol.  11,  No.  1,  1951, 

Po  24. 

25 Ibid. 
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known  when  cross-validation  is  used,  and  suggests  a  procedure 

where  statistical  inference  and  cross-validation  can  be  combined. 

However,  Travers  suggested  that  the  problem  of  handling 

shrinkage  by  statistical  methods  has  not  been  solved  satisfactorily 

in  spite  of  considerable  study,  and  that  when  multiple  correlation 

27 

techniques  are  used,  cross-validation  should  be  carried  out. 


,  II.  LITERATURE  PERTAINING  TO  PREDICTION  FOR 
TECHNICAL  AND  VOCATIONAL  PROGRAMS 

28 

Geiss  attempted  to  measure  the  relationship  between  high 
school  background  and  success  in  the  various  technical  programs 
offered  at  the  Oregon  Technical  Institute.  He  reported  the  number 
of  students  who  passed  and  who  failed  against  whether  or  not  they 
had  taken  a  given  high  school  course,  or  against  the  number  of 
units  of  study  they  had  completed  in  high  school  in  a  particular 
academic  area.  His  sample  consisted  of  all  those  students  who 


26Ibide,  pp.  25-28 

27 

Robert  M.  Travers,  An  Introduction  to  Educational  Research. 
(New  York:  The  MacMillan  Co.,  1964),  p.  379. 

28 

Almon  Lewis  Geiss,  "An  Analysis  of  Relationships  Between 
Courses  Taken  in  High  School  and  Success  in  Specific  Areas  at  the 
Oregon  Technical  Institute,"  Doctoral  Dissertation,  (Washington  State 
University,  1966),  and  Ann  Arbor,  Mich.,  University  Microfilms,  1966. 
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entered  the  institute  in  I960,  1961  and  1962.  He  did  a  separate 

analysis  for  students  who  entered  with  a  high  school  grade  point 

average  of  2  or  better  and  for  those  who  entered  with  a  high 

school  grade  point  average  of  less  than  2. 

For  Electronics  Technology  students,  Geiss  reported  the  most 

significant  relationship  between  completion  of  a  high  school  physics 

29 

course  and  success  in  electronics*  Out  of  26  electronics  students 
with  a  G.P.A.  of  2  or  better  in  high  school,  49  {U2%)  failed.  Out 
of  2o  electronics  students  with  a  high  school  grade  point  average 
of  less  than  2,  19  {13%)  failed,^ 

Generally  for  engineering  technologies  he  found  that  comple¬ 
tion  of  physics,  chemistry  and  mathematics  courses  in  high  school 
correlated  most  highly  with  success*  There  were  substantial 
differences  between  the  success  ratios  of  those  students  who 
entered  v/ith  a  high  school  G.P.A.  of  2  or  better  and  those  who 
entered  with  a  high  school  G.P.A.  of  less  than  2.  He  also  found 
that  the  number  of  industrial  arts  courses  a  student  had  in  high 
school  correlated  negatively  with  success  ratio  in  all  technologies, 

'  and  that  nonacademic  courses  apparently  do  not  prepare  students  for 

31 

success  at  Oregon  Technical  Institute. 

^ 9 Ibid. ,  p.  96 
^ 19 Ibid . ,  p.  67 
~^Ibid. ,  pp.  96-101, 
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Carlin  studied  the  effectiveness  of  intelligence,  reading, 
and  mathematics  scores  as  predictors  of  success  in  four  vocational 
high  schools  in  New  York  city.  He  found  a  significant  difference 
between  intelligence  scores  of  graduates  and  dropouts,  but  did  not 
recommend  that  they  be  used  alone  for  counselling.  He  found  differ¬ 
ences  in  arithmetic  scores  of  graduates  and  dropouts  to  be  consis¬ 
tently  significant  and  substantial,  and  suggested  that  a  critical 
arithmetic  score  would  be  the  best  single  predictor  of  success  in 
the  vocatiohal  program.  He  also  recommended  that  the  school  board 

32 

include  aptitude  tests  in  their  counselling  battery  in  the  future. 

Checkley  investigated  the  validities  of  D.A.T.  scores,  Lorge 
Thorndike  intelligence  scores,  and  the  Grade  XII  high  school  average 
for  predicting  success  in  the  N.A.I.T.  Business  Administration  pro¬ 
gram  first  quarter  examinations.  His  sample  consisted  of  the  93 
Business  Administration  students  who  entered  the  program  in  1966 
and  for  whom  complete  data  was  available.  He  found  that  a  regress¬ 
ion  equation  including  8  of  the  predictor  variables  accounted  for 

33 

53^  of  the  variance  in  the  first  quarter  Business  average. 


-^Francis  X.  Carlin,  "Intelligence,  Reading  and  Arithmetic 
Scores  as  Predictors  of  Success  in  Selected  Vocational  Schools." 
(Doctoral  Dissertation,  Fordham  University,  1962),  also  Ann  Arbor: 
University  Microfilms,  1962. 

-^Stanley  Meno  Checkley,  "The  Prediction  of  Academic  Success 
for  Business  Administration  Students  after  First.  Quarter  Examinations" 
(unpublished  Institutional  Study,  Northern  Alberta  Institute  of 
Technology,  Edmonton,  1961),  p.  16. 
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The  D.A.T.  numerical  ability  subtest  accounted  for  of 
the  variance  in  Business  Administration  average  alone,  whereas 
that  variable  in  combination  with  the  Large  Thorndike  verbal  and 
the  Grade  12  average  would  have  accounted  for  4 6%  of  the  total 

Ol 

variance  in  first  quarter  Business  Administration  average.  ^ 

Price  studied  the  use  of  the  D.A.T.  battery,  and  the  Lorge 
Thorndike  Intelligence  tests  for  predicting  success  in  first  quar¬ 
ter  Year  A  Technology  courses  and  first  quarter  Year  A  Technology 
average  at  N.A.I.T.  His  sample  included  the  105  students  who  en¬ 
tered  the  program  in  1966  and  for  whom  complete  data  was  available. 

By  the  use  of  a  stepwise  multiple  linear  regression  tech¬ 
nique  he  found  that  a  combination  of  D.A.T.  Spatial  Relations,  D.A.T. 

Clerical  Speed  and  Accuracy  and  D.A.T,  Numerical  Ability  score  pre- 
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dieted  3h%  of  the  variance  in  first  quarter  average. 

Karpoff  attempted  to  identify  the  aptitude  and  achievement 
scores  which  would  best  predict  success  in  the  22  Series  Vocational 
courses  offered  at  one  large  Alberta  high  school.  His  sample  in¬ 
cluded  the  646  students  who  completed  one  or  more  of  the  vocational 
22  series  courses  at  that  high  school  in  1964,  1965  and  1966,  and  for 
whom  complete  data  was  available.  The  27  predictor  variables  included 


3^Ib.id. 

3 ^Donald  W.  Price.  "Predictive  Validity  of  the  D.A.T.  Subtest 
Scores  and  the  Lorge  Thorndike  Subtest  Scores  on  Year  A  Students  at 
N.A.I.T."  (Unpublished  Institutional  Study,  Northern  Alberta 
Institute  of  Technology,  Edmonton,  1967). 
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the  grade  IX  Departmental  Examination  scores,  the  D.A.T.  battery 
scores,  and  the  Kuder  Preference  Record-Vocational,  He  set  up 
regression  equations  for  each  of  10  courses  in  the  vocational  22 
series  courses,  and  found  that  between  4  and  7  variables  accounted 
for  maximum  variance  in  each  case,  which  ranged  from  29%  to  69% 
of  the  criterion  variance.  His  regression  equation  for  electronics 
22  scores  (N  =  86)  resulted  in  an  R  =  0.728,  The  equation  included 
4  predictor  variables,  the  grade  IX  science  mark,  the  Kuder  Compu¬ 
tational  Score,  D.A.T.  Verbal  Reasoning  score,  and  the  Verbal 
Scat  (-)?7 

38 

Karpoff'  did  not  cross-valid ate  his  regression  equations. 

It  seems  that  the  multiple  correlation  of  the  equation  arrived  at 

for  predicting  electronics  scores  might  well  shrink  upon  cross- 

validation,  as  it  includes  two  verbal  scores,  one  with  a  (+)  beta 

weight  and  another  with  a  (-)  beta  weight. 

39 

Campbell  investigated  the  predictive  validity  of  grade  IX 
Departmental  scores  at  a  Vocational  high  school  in  Alberta.  His 
sample  consisted  of  the  443  students  who  completed  one  or  more  of 
the  10  vocational  courses  offered  by  that  school  during  the  period 

3^John  Theodore  Karpoff.  ’’Aptitudes  for  Achievement  in  the 
Vocational  Programs  of  One  Composite  High  School  in  Alberta,” 
(unpublished  M,  Ed  Thesis,  University  of  Alberta,  Edmonton,  1967.) 

37Ibid. ,  p.  84 

3 ^ Ibid. 

-^Theodore  Roy  Campbell.  ’’Grade  IX  Marks  as  Predictor  Criteria 
For  Success  in  Selected  Vocational  Subjects,”  (Unpublished  Master's 
Thesis,  University  of  Alberta,  Edmonton,  1966.) 
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1963  -  1966  inclusive.  Grade  IX  subjects  which  had  the  highest  zero 
order  correlations  with  final  grades  in  a  vocational  subject  were 
most  often  Science  IX,  Math  IX,  and  Q.  S.C.A.T.  with  the  median 
highest  single  correlation  coefficient  being  The  average 

level  of  criterion  variance  explained  by  multiple  regression  equat¬ 
ions  for  the  individual  subjects  was  found  to  be  29.2 1$  which  the 
investigator  concluded  was  too  low  to  justify  their  use  over  that 
of  the  single  best  predictor.  This  is  probably  especially  true 
in  the  case  where  samples  v/ere  small,  the  extreme  case  being  where 
N  =  12,  and  the  predictor  equation  contained  3  predictor  variables. 


III.  REVIEW  OF  LITERATURE  RELATED  TO  THE 
PREDICTION  OF  SCHOOL  AND  COLLEGE  PERFORMANCE 

The  vast  majority  of  prediction  studies  have  been  concerned 
with  the  prediction  of  college  performance,  especially  the  prediction 
of  first  year  college  performance.  The  following  is  a  review  of  some 
literature  related  to  prediction  of  school  and  college  performance 
with  a  special  emphasis  on  studies  which  used  data  beyond  the  first 
year  level  and  those  which  v/ere  concerned  primarily  with  the  Alberta 


^°Ibid. ,  p.  82. 
^Ibid.,  p.  87. 
/t2Ibid.,  p.  76. 


scene. 


. 


. 


. 


29. 


Scott  investigated  the  correlations  between  high  school  grades 
and  college  performance  in  mathematics  and  science  with  data  from  the 
graduates  of  the  University  of  Arkansas  during  the  period  I960  -  1964. 
He  concluded  that  the  average  achievement  in  all  high  school  mathemat¬ 
ics  and  science  courses  is  an  excellent  predictor  of  freshman  success 
in  mathematics  and  science  courses,  a  good  predictor  of  sophomore 
success  in  mathematics  and  science,  and  a  poor  predictor  of  perform- 

I  1 o 

ance  in  junior  and  senior  mathematics  and  science.  J 

i 

A  summary  of  his  findings  for  overall  averages  is  tabulated 

below: 


TABLE  I 

INTERCORRELATIONS  BETWEEN  ACHIEVEMENT  IN  EACH  OF  THE  FOUR  CLASS  LEVELS 
FOR  ALL  COLLEGE  SCIENCE  AND  MATHEMATICS  AT  THE  UNIVERSITY  OF  ARKANSAS.^ 


1 

2 

3 

4 

1. 

All  Freshman 

r 

1.000  0.634 

0.401 

0.312 

Science  &  Math 

N 

1095 

953 

411 

264 

2. 

Sophomore 

r 

1.000 

0.607 

0.449 

N 

953 

397 

264 

3. 

Junior 

r 

1.000 

0.577 

N 

411 

259 

4. 

Senior 

r 

1.00 

N 

264 

• 

^ Ralph  Lincoln 

Scott , 

"The 

Relationship 

Between 

Achievement  in 

High  School  and  Success  in  College  with  Reference  to  Science  and  Mathe¬ 
matics,  (Doctoral  Dissertation,  University  of  Arkansas,  1966),  and 
(University  Microfilms,  Ann  Arbor,  1966),  p.  370 

^Ibid. ,  p.  314. 
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In  the  above  table  the  low  correlations  between  perform¬ 
ance  in  the  different  college  years  are  of  special  interest,  with 
first  year  science  and  mathematics  scores  accounting  for  something 
less  than  10%  of  the  variance  in  fourth  year  science  and  mathematics 
achievement. 

I  5 

A  major  criticism  of  Scott's*"  study  would  be  that  he  used 
only  data  from  graduates.  It  would  seem  that  the  value  of  the 
study  would  be  somewhat  limited  for  counselling  prospective  students, 
as  the  population  applying  for  admission  to  a  college  is  quite  diff¬ 
erent  from  the  graduate  population. 

Lewis  carried  out  a  study  to  investigate  the  efficiency  of 
pre-college  variables  for  predicting  grade  point  averages  for  stud¬ 
ents  enrolled  in  the  Iowa  State  University's  College  of  Pharmacy  in 
1952,  1953  and  1954.  Rank  in  high  school  class,  high  school  G.P.A., 
the  number  of  high  school  physical  science  units  completed,  and  the 
percentile  mathematics  scores  of  the  College  Entrance  Tests  were  used 
as  predictors. 

He  found  the  multiple  correlation  coefficient  between  predic¬ 
tors  and  freshman  G.P.A.  to  be  0.6,  However,  the  validity  of  these 
predictors  fell  markedly  as  predictors  of  sophomore  and  junior  achieve 
ment,  and  he  used  freshman  G.P.A.  and  sophomore  G.P.A.  in  his  pred¬ 
ictor  equations  for  junior  performance,  which  kept  multiple  R  at  the 

1  / 

0.6  to  0. 7  level, + 


^John  W.  Lewis,  "Pre-College  Variables  as  Predictors  of 
Freshman,  Sophomore  and  Junior  Achievement,"  Educational  and  Psycho¬ 
logical  Measurement,  Vol.  24 >  No,  2,  1964,  pp,  353-356. 
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The  fact  that  Lewis*  prediction  equations  included  the 

freshman  and  sophomore  G. P.A.  to  predict  success  in  the  junior  year 

would  render  them  of  little  value  for  counselling  the  prospective 

pharmacy  student  as  this  information  would  not  be  available  at 

the  time  the  decision  to  enter  the  program  would  be  made. 

47 

V/ood  and  Lebold 4'  carried  out  one  of  the  few  cross-validated 
studies  encountered  in  their  development  of  equations  for  prediction 
of  freshman  success  in  engineering  at  Purdue  University.  The  sample 
consisted  of  the  6l6  engineering  freshman  who  were  enrolled  in  an 
engineering  graphics  course  in  1966.  106  of  the  students  were  ran¬ 

domly  selected  from  the  sample  as  a  cross-validation  sample.  Pre¬ 
dictors  used  were  high  school  rank  in  class  and  scores  on  the  fol¬ 
lowing  tests:  D.A.T.  Clerical  Speed  and  Accuracy,  Spatial  Relations, 
Mechanical  Reasoning,  Abstract  Reasoning,  S.A.T.  Verbal  and  S.A.T. 
Mathematics. 

High  school  rank,  D.A.T.  Spatial  Relations  and  S.A.T.  Mathe¬ 
matics  were  found  to  be  optimal  predictors,  with  D.A.T.  Mechanical 

L.8 

Reasoning  also  valuable  in  prediction  of  graphics  grades.  Multiple 

R's  ranged  from  0.58  to  0.3$j  and  cross-validation  correlations 

49 

ranged  from  0.50  to  0.32. 


^Donald  A.  Wood  and  William  K.  Lebold,  "Differential  and 
Overall  Prediction  of  Academic  Success  in  Engineering,"  Educational 
and  Psychological  Measurement.  Vol.  28,  No.  4,  1968,  pp.  1223-1228. 

/;8Ibtd. ,  p.  1226 


49 


Ibid 


O  f 


* 


■ 

. 

(  : 


32. 

Black  carried  out  a  series  of  studies  related  to  the  predic¬ 
tion  of  freshman  success  at  the  University  of  Alberta*  In  a  study 

to  determine  the  validities  of  grade  IX  Departmental  grades  for 

50 

predicting  freshman  success.  Black  used  the  data  from  529  students 

who  entered  the  University  of  Alberta  in  1956.  Black  reported  a 

multiple  correlation  coefficient  of  0.408  between  freshman  university 

average  and  a  predictor  combination  which  included  the  scores  in  grade 

IX  math,  science,  social  studies,  and  reading  grades,  in  that  order 

of  weight.  Black  concluded  that  it  is  possible  to  predict  success 

in  related  university  freshman  courses  on  the  basis  of  grade  IX  results 

with  a  sufficient  degree  of  accuracy  that  such  prediction  would  be 

51 

of  real  value  in  the  guidance  program. 

It  must  be  remembered,  however,  that  the  sample  was  a  very 
select  group  of  grade  IX  students,  with  a  mean  grade  IX  average  be¬ 
tween  75  and  80$. 

In  another  study  with  the  data  on  the  same  group  of  529  stud¬ 
ents,  Black  investigated  the  validity  of  grade  XII  Departmental  marks, 
grade  IX  departmental  marks,  S.C.A.T.  scores,  A.C.E.  subtest  scores, 

C.E.E.B.  scores  and  S.A.T.  scores  for  the  prediction  of  freshman 
52 

success. 


^°Donald  B.  Black,  "The  Prediction  of  University  Freshman  Success 
Using  Grade  IX  Departmental  Scores",  Alberta  Journal  of  Educational 
Research,  Volc  5>  No.  4,  1959*  PP*  229  -  239. 

51Ibid. ,  p.  234 

^^Donald  B.  Black,  "Prediction  of  Freshman  Success  in  the 
University  of  Alberta  from  Grade  XII  Departmental  Results,"  Alberta 
Journal  of  Educational  Research,  Vol.  6,  No.  1,  I960,  pp.  38-53. 
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He  found  the  grade  XII  science  average  to  have  the  largest  zero 
order  correlation  with  university  average  (r  =  0.632),  and  a  re¬ 
gression  equation  which  combined  the  grade  XII  Departmental  grades 
in  English,  Science  average,  Math  average,  Foreign  Language  and 
Social  Studies,  was  deemed  to  be  the  best  operational  combination 
for  all  university  courses  studied.  '  Multiple  correlations  report¬ 
ed  with  this  combination  of  predictors  was  +  O.656  for  the  whole 
group  and  0.670  for  that  part  of  the  group  in  engineering.^^ 

1 

In  a  follow-up  study  Black’s  regression  equations  were 

applied  six  years  later  to  another  sample  of  students  entering 

engineering.  The  prediction  equation  was  not  found  to  shrink 

55 

significantly. ' 

Knowles  and  Black  studied  the  use  of  the  Principals’  Confi¬ 
dential  Estimates  of  the  Grade  XII  Departmental  Examination  results 
for  prediction  of  freshman  success,  and  found  that  the  loss  of  pre¬ 
dictive  efficiency  when  principals’  estimates  are  used  in  place 

r56 

of  the  actual  Departmental  scores  was  only  2,3%  This  would  seem 


^Ibid. ,  p.  45. 

54 Ibid. 

^Donald  B.  Blade,  ’’Validity  of  Regression  Equations  After  Six 
Years  to  Predict  Freshman  Success  in  Engineering, ”  Alberta  Journal 
of  Educational  Research,  Vol.  10,  No.  I,  1964,  pp.  125-136. 

^Donald  B.  Black  and  Donald  W. Knowles,  "The  Effectiveness 
of  the  Grade  XII  Principals ’  Rating  Scores  to  Predict  Freshman  Success 
at  the  University  of  Alberta,”  Alberta  Journal,  of  Educational  Research 
Vol.  XI,  No.  2,  p.  125. 
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to  confirm  Bloom's  contention  that  teachers’  grades  were  perhaps 
more  accurate  than  are  commonly  credited. 

P"air* 5^  investigated  the  validity  of  the  grade  XII  average, 
and  scores  on  A.C.E.  and  C.O.O.P.  English  tests  for  predicting 
success  of  freshmen  in  Education,  He  found  the  grade  XII  average 
to  be  the  best  single  predictor  of  freshman  success  in  Education, 
and  that  prediction  of  success  from  the  grade  XII  average  was  . 
almost  as  accurate  as  that  obtained  when  all  six  predictors  were 
used  in  a ‘regression.  Fair  reported  a  zero  order  correlation  be¬ 
tween  freshman  average  and  grade  12  average  at  r  =  +  0.44  for  males 
(N  =  180)  and  r  =  0.64  (N  -  318)  for  females.59 

Evanson  and  Smith^  reported  the  findings  of  a  study  wherein 
some  of  the  correlates  of  university  achievement  were  investigated 
with  a  sample  from  those  who  entered  the  University  of  Alberta  as 
freshmen  in  1951.  Some  of  their  findings  pertinent  to  this  study 
are  summarized  in  the  tables  below. 


57 


Bloom,  op.  cit 


o 


5^Donald  C.  Fair,  "Predictive  Validity  of  the  Grade  Twelve 
Average  and  Scores  on  the  American  Council  on  Education  Psychological 
Examination  and  Co-operative  English  Tests  for  Achievement  in  the 
Faculty  of  Education."  (Research  Bulletin  of  Student  Counselling 
Services,  University  of  Alberta,  Edmonton),  Vol.  1,  No.  3,  1964, 
(mimeographed ) • 


5 9 Ibid. ,  pp.  4-5 

Za 

A.  B.  Evanson  and  D.  E.  Smith,  "A  Study  of  Matriculation 
in  Alberta,"  Albert, a  Journal  of  Educat ional_ .Research,  Vol.  4,  No.  2, 
1958,  ppo  67  -  83. 
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TABLE  II 

COEFFICIENTS  OF  CORRELATION  (r)  BETWEEN  FIRST  YEAR  MARKS  AT  UNIVERSITY 

AND  MARKS  IN  LATER  YEARS61 


First  Year  Average  with: 

r  No.  of  Cases 

Second  Year  University  Average 

0.63  51 

i 

Final  Year  University  Average 
Students  graduating  in  3  years) 

0.45  181 

Final  Year  University  Average 
(Students  graduating  in  4  years) 

0.47  199 

Students  graduating  in  4  years  includes  students  graduating  in  normal 
time  in  a  4  year  course,  and  those  who  took  4  years  to  complete  a 


4  year  program. 

6lT1_  .  ,  „ 

Ibid.,  p0  70 


•• 
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TABLE  III 

COEFFICIENTS  OF  CORRELATION  (r)  BETWEEN  GRADE  IX  RESULTS  AND  UNIVERSITY 

MARKS  OF  1951  FRESHMEN62 


Correlated  With: 

Gr.  IX 

Average 

Gr.  IX 

General  Test 

r 

No.  Cases 

r 

No.  cases 

First  Year  University  Average 

0.40 

647 

0.14 

640 

Final  Year  University  Average 
(Students  graduating  in  3  years) 

0.42 

117 

0.16 

116 

Final  Year  University  Average 
(Students  graduating  in  4  Years) 

0.25 

152 

0.15 

151 

62 


Ibid, 


68 
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TABLE  IV 

COEFFICIENTS  OF  CORRELATION  (r)  BETWEEN  GRADE  XII  STANDING  OR  A.C.E. 
SCORES  AND  UNIVERSITY  MARKS  OF  1951  FRESHMEN63 


Correlated  with: 

Gr.  XII  Average 

A.C.E. 

Score 

r 

No.  Cases 

r 

No.  Cases 

First  Year  University  Average 

0.48 

881 

0.36 

523 

Second  Year  University  Average 

0.54 

478 

0.16 

350 

Final  Year  University  Average 
(Students  graduating  in  3  Years) 

0.36 

170 

0.15 

116 

Final  Year  University  Average 
(Students  graduating  in  4  years) 

o 

. 

vn 

O 

191 

0.18 

136 

The  observation  that  the  intercorrelations  between  achievement  in 

the  different  years  of  university  are  quite  low,  and  lower  than 

that  between  the  grade  XII  average  and  achievement  in  some  cases 

6A 

is  of  particular  interest  in  the  findings  of  Evanson  and  Smith. 
However,  it  must  be  remembered  that  comparisons  between  the 
correlations  are  somewhat  risky  in  that  different  samples  were 
used  for  each  correlationc 


63Ibid. ,  p.  69 
6^ Ibid , , 


' 
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IV.  OBSERVATIONS  FROM  THE  LITERATURE 

1.  A  vast  amount  of  prediction  research  has  been  done  for 
estimating  first  year  university  achievement.  However,  very  little 
research  has  been  done  in  predicting  success  in  the  later  college 
years. 

2.  Of  the  investigations  on  the  predictability  of  success 
through  the  length  of  the  program,  almost  all  use  data  for  only 
those  who  complete  the  course.  This  limits  the  usefulness  of  the 
information  for  counselling  prospective  students,  as  the  selected 
population  that  succeeds  must  necessarily  be  different  from  popu¬ 
lation  which  enters  the  program  in  any  situation  where  prediction 
is  to  be  of  value. 

3.  The  high  school  academic  average  seems  to  be  a  good 
predictor  of  freshman  success  in  university  and  remains  reasonably 
stable  as  a  predictor  of  success  over  the  length  of  the  program. 

4.  There  appears  to  be  a  paucity  of  literature  in  the 
area  of  prediction  studies  for  vocational  and  technical  programs, 
especially  as  compared  to  the  amount  of  literature  relating  to 
prediction  of  college  success.  Vocational  and  technical  programs 
are  generally  more  specialized  and  less  academic  than  university 
programs.  Further,  the  entrance  requirements  for  vocational  and 
technical  schools  are  usually  lower  with  respect  to  high  school 
academic  standing  than  are  the  entrance  requirements  of  universities. 
This  factor  may  well  result  in  different  student  populations  in  the 
different  institutions.  Hence,  good  predictors  of  success  in 


’ 
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university  programs  are  not  necessarily  valid  predictors  of  success 
in  technical  and  vocational  programs. 

5.  The  consistency  of  performance  over  the  length  of  a  pro¬ 
gram  appears  to  be  a  limiting  factor  in  the  prediction  of  success, 
with  the  intercorrelations  between  achievement  in  the  different  col¬ 
lege  years  often  being  no  higher  than  the  intercorrelations  bet ween 
college  achievement  and  combinations  of  pre-college  variables.  • 

6.  A  combination  of  high  school  achievement  scores  and  ap¬ 
titude  scores,  as  determined  by  multiple  linear  regression  procedures, 
has  often  been  found  to  predict  up  to  50%  of  the  variance  in 
freshman  success. 

7.  Sometimes  simple  combinations  of  predictor  scores,  such 
as  averages,  have  been  found  to  be  as  efficient  for  prediction  as 
regression  scores. 

8.  Studies  using  multiple  linear  regression  procedures 
should  be  cross-validated. 

9.  Certain  subtests  of  the  D.A.T.  and  S.C.A.T.  have  been 
found  to  be  significant  predictors  of  success  in  college  and  tech¬ 
nical  programs. 

10.  Teachers'  marks  can  be  as  effective  for  prediction 
purposes  as  standardized  examinations  which  measure  high  school 


achievement 


. 
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CHAPTER  III 


EXPERIMENTAL  DESIGN  AND  PROCEDURES 

The  purpose  of  this  investigation  was  to  obtain  information 
which  could  be  useful  for  the  prediction  of  success  in  the  N.A.I.T. 
three  year  Electronics  program,  to  provide  some  information  about 
the  stability  of  performance  over  the  length  of  the  program,  and 
to  provide  some  descriptive  statistics  regarding  high  school 
achievement  and  ability  measures  of  the  students  entering  the 
Electronics  program. 

I.  THE  SAMPLES 

Sample  1  consisted  of  those  students  who  had  registered  in 
the  N.A.I.T.  three  year  Electronics  program  in  September,  1965  and 
for  whom  the  following  conditions  were  met: 

1.  those  for  whom  complete  predictor  data  was  available. 

2.  those  who  either  completed  the  program  or  were  drop-outs 
with  poor  achievement. 

3.  those  who  were  not  repeating  a  year  of  the  program. 

A.  those  who  remained  in  the  program  until  February  of 
Year  A.  2 


^See  page  12. 

?D.A.T.  was  written  by  1965  group  in  February,  1966,  therefore 
only  those  from  both  groups  who  remained  in  the  program  until  February 
of  Year  A  were  included. 


. 
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5.  those  for  whom  achievement  records  were  available  at 

N.A.I.T. 

6.  those  who  had  received  their  high  school  training  in 
Alberta  and  who  had  written  their  grade  IX  Departmental 
less  than  6  years  before  entering  the  Electronics  program. 

Sample  2  consisted  of  those  students  who  entered  the  N.A.I.T. 
three  year  Electronics  program  in  September,  1966,  and  for  whom  the 
six  conditions  listed  for  sample  one  were  met. 

Sample  3  consisted  of  those  students  who  entered  the  N.A.I.T. 
three  year  Electronics  program  in  September,  1966  and  for  whom  the 
following  conditions  were  met: 

1.  those  for  whom  D.A.T.  subtest  scores  were  available. 

2.  those  for  whom  records  in  Electronics  were  available  at 

N.A.I.T. 

3.  those  who  remained  in  the  program  until  February  of  Year 

A. 

4c  those  who  either  completed  the  program  or  were  drop-outs 
with  poor  achievement o 

5.  those  who  were  not  repeating  a  year  of  the  program. 

Sample  4  consisted  of  those  students  who  entered  the  N.A.I.T. 
three  year  Electronics  program  in  September,  1966  and  for  whom  the 
5  conditions  listed  for  sample  3  were  met. 

Table  V  summarizes  the  sampling  procedure  and  shows  a 
number  of  students  in  each  sample. 


,  f 
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TABLE  V 

SAMPLE  SELECTION 
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Classification 

Sept  • 
1965  • 

Sept.  SamDle  Sample  Sample  Sample 

1966  1  2  3  4 

Total  Year  A  Technology 

Registrants 

143 

121 

Exploration  Technology 

-30 

-26 

Instrumentation  Technology 

-10 

-17 

Transfer  to  other  Technologies  ->3 

-0__ 

“43 

“43 

Total  Year  A  Electronics 

110 

78 

Left  program  before  Feb.  of 

Year  A  (time  of  writing  DAT 

for  Sept/65  group. ) 

-2 

-2 

In  program  till  Feb.  of  Year 

A 

but  did  not  write  D.A.T. 

“5 

“5 

Record  of  technology  program 

not  available 

“4 

“3 

Repeat  from  another  year,  or 

transfer  in 

-6 

-2 

Withdrew  for  reasons  other 

than  poor  achievement 

-7 

-KL 

Total  useable  Sample 

76 

56  76  56 

Students  who  took  their  high 


school  outside  of  Alberta 

-10 

-4 

Alberta  non-adult  students, 
high  school  records  not 
available 

-1 

-0 

Adult  students  from  Alberta 

-6 

Total  sample,  non-adult,  Alberta 

46 

Students 

30 

46 


. 


* 
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II.  DATA  USED 


The  raw  data  used  in  this  investigation  consisted  of: 

1.  the  final  marks  in  the  selected  Grade  10  and  11  subjects, 
in  intervals  of  5  percent,  as  recorded  in  the  files 

of  the  Alberta  Department  of  Education. 

2.  the  final  marks  on  the  Grade  IX  Departmental  Examinations 
as  recorded  in  the  files  of  the  Alberta  Department  of 
Education.  All  marks  we re  in  percent  except  for  S.C.A. T. 
scores.  The  S.C.A.T.  total  was  in  percentile,  while  the 
S.C.A.T.  verbal  and  quantitative  scores  were  in  stanine 
form. 

3 

3.  the  D.A.T.  subtest  raw  scores  as  recorded  by  Wilson 

and  in  the  files  of  the  N.A.I.T.  counselling  department. 

4.  rank  in  class  on  the  basis  of  weighted  average  for  each 
year  of  the  Electronics  program,  as  recorded  in  the  files 
of  the  registrar  at  N.A.I.T.  (where  rank  data  was  not 
available  final  grades  in  each  course,  in  percentage, 
were  obtained  from  the  same  files). 

The  D.A.T.  Battery, Form  B,  was  administered  in  February,  1966 
to  the  group  which  entered  Year  A  Technology  in  September,  1965.  The 
D.A.T.  Battery,  Form  L  was  administered  in  November,  1966  to  the  group 
which  entered  Year  A  Technology  in  September,  1966.  Administration  of 
the  tests  was  carried  out  under  the  supervision  of  the  N.A.I.T.  guid¬ 
ance  department. 


^D.W.R.  Wilson  and  F.H.  Babet ,( "Establishment  of  Differential 
Aptitude  Test  Norms  for  Electronics  Technology  Students,"  Unpublished 
Institutional  Study,  Northern  Alberta  Institute  of  Technology,  Edmonton 
1966.) 


.  ' 
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Until  this  year  Grade  IX  Departmental  Examinations  were 
administered  to  the  total  Alberta  Grade  IX  population  each  June* 

The  tests  were  constructed  by  individuals  designated  by  the  Alberta 
Department  of  Education,  and  were  scrutinized  and  modified  by  rev¬ 
isions  committees  appointed  by  the  Alberta  Department  of  Education. 

The  tests  were  sent  to  the  schools  in  June,  and  administration  was 
carried  out  according  to  regulations  and  a  schedule  published  by 
the  Department  of  Education. 

Tests  were  machine  scored  or  marked  by  teams  working  under 
the  direct  supervision  of  the  Department  of  Education.  The  scores 
were  scaled  on  the  basis  of  the  performance  of  the  total  Alberta 
Grade  IX  population  of  a  given  year. 

The  S.C.A.T.  test  was  administered  as  part  of  the  Grade  IX 
Departmental  Examination  Battery. 

Marks  in  grade  10  and  11  courses  were  recorded  in  Department 
of  Education  files  as  received  from  individual  schools.  These  marks 
were  usually  as  assigned  by  individual  subject  teachers. 

Marks  in  individual  courses  at  N.A.I.T.  are  usually  based 
partly  on  individual  teacher  ratings  and  partly  on  common  examinations 
though  procedure  varies  from  department  to  department. 

III.  DATA  TRANSFORMATIONS 

The  raw  data  for  grade  9  results  was  used  as  obtained. 

The  mean  of  the  two  final  course  marks  in  each  of  the  sel¬ 
ected  grade  10  and  11  subjects^  was  calculated.  Where  a  student 

^See  page  47  for  list  of  selected  grade  10  and  11  subjects. 
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repeated  a  course  he  was  assigned  the  average  of  his  final  grades 
as  his  mark  in  that  course. 

The  D.A.T.  subtest  scores  were  converted  to  percentile  scores 

on  the  basis  of  grade  12  norms  provided  in  the  D.A.T.  handbook  for 

5 

Form  B,  and  grade  12  spring  norms  provided  in  the  D.A.T.  handbook 
for  Form  L,  ^ 

7 

The  weighted  averages  of  the  N.A.I.T.  grades  were  calcula¬ 
ted  for  each  year  of  the  program.  The  students  in  each  sample  were 

g 

then  ranked  in  accordance  with  the  relative  success  model.  That  is, 
they  were  ranked  on  the  basis  of  their  weighted  averages  for  that 
year.  If  a  student  dropped  out  before  the  completion  of  that  year, 
he  was  ranked  below  those  who  completed  the  year,  and  below  those 
who  dropped  out  after  him;  he  was  ranked  above  those  who  dropped 
out  before  him.  All  students  who  dropped  out  in  the  same  quarter  were 
ranked  according  to  weighted  average  in  the  final  quarter. 


c 

George  K.  Bennett,  Harold  G.  Seashore  and  Alexander  G.  Wesman, 
(Differential  Aptitude  Test s ,  Manna 1 ,  Second  Ed. ,  The  Psychological 
Corporation,  New  York:  1952),  p.  34. 

^George  K.  Bennett,  Harold  G.  Seashore  and  Alexander  G.  Wesman, 
(Differential  Aptitude  Tests,  Manual,  Fourth  Ed.,  The  Psychological 
Corpora! ion,  New  York:  1966),  p.  3-20. 

^For  definition  of  weighted  average,  see  page  11. 

8For  definition  of  Relative  Success,  see  page  10. 
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The  ranks  were  then  converted  to  T  scores,  with  a  normal 


distribution,  mean  of  50,  and  standard  deviation  of  10, 

The  relative  success  model  for  criterion  data  was  used 
for  the  following  reasons: 


1.  it  made  possible  the  inclusion  of  data  for  those  who 
dropped  out  due  to  poor  achievement  as  well  as  those 
who  completed  the  program,  thereby  making  the  sample 
more  nearly  like  the  total  group  that  entered  the 
program  than  would  have  been  the  case  if  only  data  from 
those  that  completed  the  program  were  included* 

2.  it  offered  some  control  for  the  fact  that  different 
forms  of  the  D.A.T.  were  administered  to  the  different 
samples  at  different  points  in  the  program. 

3*  it  offered  some  control  for  possible  differences  in 
standards  from  one  year  to  the  next,  a  factor  which 
was  considered  to  be  important  because,  at  the  end 
of  Year  A  three  year  students  are  put  in  some  of  the 
same  courses  and  classes  as  high  school  graduates  who 
enter  the  two  year  electronics  program. 

The  criterion  scores  were  transformed  to  T  scores  to  avoid 


correlating  variables  with  rectangular  distributions  (ranks),  with 
variables  which  were  assumed  to  have  more  nearly  normal  distribu- 
tions,  and  because  it  would  facilitate  application  of  results. 


IV.  PREDICTOR  VARIABLES 


The  predictor  variables  used  were: 


A.  Grade  IX  final  grades: 


XI  Reading,  percent 


X5  Mathematics,  percent 


X2  Literature,  percent 


X6  Science,  percent 


X3  Language ,  percent 


X7  S.C.A.T.  total,  percentile 


X4  Social  Studies,  percent 


X8  S.C.A.T.  Verbal,  Stanine 


■ 


_ 


X9  S.G.A.T.  Quantitative,  St.anine 


1  and 


B«  The  means  of  the  final  grades  in  the  two  courses  in 

each  of  the  selected  grade  10  and  11  subject  areas: 

X10  mean  of  final  grades  in  English  10  and  English  20 

Xll  mean  of  final  grades  in  Social  Studies  10  and  Social 
Studies  20 

X12  mean  of  final  grades  in  Mathematics  10  or  12  and 
Mathematics  20  or  22 

X13  mean  of  final  grades  in  Science  10  and  Science  20 

C.  The  D.A.T.  subtest  percentile  scores: 

X14  Abstract  Reasoning 

X15  Clerical  Speed  and  Accuracy 

Xl6  Mechanical  Reasoning 

X17  Numerical  Ability 

X1S  Spelling 

X19  Sentences 

X20  Spatial  Relations 

X21  Verbal  Reasoning 

X22  Verbal  Reasoning  plus  Numerical  Ability 

D.  The  means  of  the  grade  9  and  grade  10  and  11  scores: 

X23  =  (XI  +  X2  +  X3  +  X4  +  X5  +  X6)/6 

X24  *=  (X10  +  XU  +  X12  +  X13 )/ u 
X25  =  (X12  +  X13  )/2 

All  of  the  predictor  variables,  XI  -  X25  were  used  for  samples 
2,  whereas  predictor  variables  X14  to  X22  we re  used  for  sample 
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V.  CRITERION  VARIABLES 


The  criterion  variables  used  were  T  scores  calculated  on 
the  basis  of  relative  success  in  each  sample  to  the  end  of  each 
year  of  the  three  year  program: 

Y1  relative  success  to  the  end  of  Year  A  of  the  N.A.I.T. 
three  year  Electronics  program, 

Y2  relative  success  to  the  end  of  Year  B  of  the  N.A.I.T. 
three  year  Electronics  program. 

Y3  relative  success  to  the  end  of  Year  C  of  the  N.A.I.T. 
three  year  Electronics  program. 

VI.  STATISTICAL  ANALYSIS  PROCEDURE 

The  data  was  punched  onto  computer  cards  by  the  staff  of  the 
Educational  Research  Services  Division,  University  of  Alberta. 

For  each  sample  the  correlation  matrix,  the  mean  and  the  stand¬ 
ard  deviation  of  each  variable,  and  the  significance  level  of  each 
zero  order  correlation  coefficient  on  the  basis  of  a  T  test,  were 
calculated  by  means  of  the  use  of  the  Dest.  02  Program,  an  I.B.M. 
360/67  program  from  the  files  of  the  Educational  Research  Services 
Division.  Regression  equations  for  each  of  the  criterion  variables 
for  sample  1  and.  for  sample  3>  were  calculated  through  the  use  of 
the  Reg.  300  Program,  an  I.B.M.  360/67  program  from  the  files  of  the 
Educational  Research  Services  Division. 

The  Reg.  300  Program  uses  a  stepwise  multiple  linear  re¬ 
gression  procedure.  The  regression  equation  using  the  predictor 
■with  the  highest  zero  order  correlation  with  the  criterion  variable 


. 
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is  determined  first,  the  predictor  which  adds  most  to  the  multiple 
correlation  coefficient  is  added  to  the  regression  equation  in  the 
next  step,  and  so  on.  Iterations  stop  when  further  addition  of 
variables  to  the  regression  equation  does  not  add  significantly  to 
the  multiple  R.  Further,  if  after  addition  of  a  variable  to  the 
regression  equation,  any  one  of  the  variables  no  longer  adds  sig¬ 
nificantly  to  the  prediction,  that  variable  is  removed  from  the 
regression  equation,  in  the  next,  step.  Percent  of  the  criterion 
variance  accounted  for  by  the  regression  equation,  the  significance 
level  of  the  regression  equation  and  the  significance  level  for 
each  variable  entering  or  leaving  the  equation  are  shown  on  the 
computer  printout  in  addition  to  the  regression  equation.  Sig¬ 
nificances  are  determined  on  the  basis  of  an  F  test. 

For  this  investigation,  significance  levels  for  variables 
entering  or  leaving  the  regression  equation  were  set  at  the  .05 
level « 

The  regression  equations  determined  for  samples  1  and  3  at 
each  step  of  the  Reg.  300  procedure  for  each  of  the  criterion  varia¬ 
bles  were  then  cross-validated  on  the  data  from  samples  2  and  4. 

The  regression  scores  were  generated  and  the  zero  order  correlations 
and  significance  levels  were  determined  by  means  of  the  Dost •  02 
program.  The  grade  9  averages  X23,  the  grade  10  and  11  averages 
X24,  and  the  math-science  average  X25,  were  also  generated  and  the 
correlation  coefficients  v/ere  also  determined  by  means  of  the  Dest. 
02  program  for  sample  1  and  for  sample  2. 
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The  best  two  combinations  of  predictors  were  then  selected 
on  the  basis  of  equal  weights  for  each  of:  a)  the  highest  average 
zero  correlation  with  the  three  criterion  variables  for  the  cross- 
validation  group,  b)  the  highest  zero  order  correlation  with  the 
criterion  variable  Y3  of  the  cross-validation  group  and  c)  the 
number  of  predictors  in  the  combination  (minus). 

The  beta  weights  for  the  regression  equations  using  these 
combinations  of  variables  for  predicting  each  of  the  three  criterion 

i 

variables  were  then  calculated  by  means  of  the  procedure  outlined 

9 

by  Ferguson,  and  the  zero  order  correlation  coefficients  between 
each  of  the  six  regression  equations  and  each  of  the  three  criterion 
variables  for  the  validation  and  for  the  cross-validation  samples 
were  determined  by  means  of  the  Dest.  02  program. 

Expectancy  tables  were  constructed  on  the  basis  of  the  best 
combinations  of  predictors  for  success  to  the  end  of  Year  C  of  the 
three  year  Electronics  program. 


^George  A.  Ferguson,  (Statistical  Analysis  in  Psychology  and 
Education,  second  edition,  McGraw  Hill  Book  Company,  New  York; 
•1966),  pp.  392-394- 
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CHAPTER  IV 


RESULTS  AND  STATISTICAL  TREATMENT 

I.  DESCRIPTIVE  STATISTICS 

Table  VI,  page  53,  shows  the  number  of  students  in  each 
sample,  and  their  distribution  with  respect  to  number  graduated 
and  time  of  drop  out.  Table  VI  indicates  that  just  over  half  of 
the  original  total  number  of  students  graduated  after  three  years 
in  the  program.  Just  under  two-thirds  of  the  group  which  regis¬ 
tered  in  1965  (Semple  3),  graduated.  Just  over  one-third  of  the 
group  which  registered  in  1966  (Sample  4),  graduated.  The  proportion 
of  students  who  graduated  from  sample  4  might  be  raised,  should  some 
of  those  who  failed  at  the  end  of  the  9th  quarter  succeed  in  passing 
supplemental  examinations  which  they  may  write  in  the  fall  of  1969. 

Taking  the  total  number  of  students  from  the  samples  into 
consideration,  it  was  found  that  approximately  equal  proportions 
of  Alberta  non-adult  students,  Alberta  adult  students  and  non- 
Alberta  students  succeeded  in  graduating. 

Table  VII,  page  54,  indicates  that  the  level  of  achievement 
of  the  students  in  samples  1  and  2  fell  generally  within  the 
middle  of  the  range  for  grade  IX  students  in  the  selected  subject 
areas  and  general  intelligence  as  measured  by  S.C.A.T.  The  students 
as  a  whole  scored  somewhat  better  with  respect  to  the  math-science 
area  than  with  respect  to  the  Language  areas. 
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Table  VIII,  page  55,  indicates  that  the  senior  high  school 
achievement,  of  the  groups  centered  around  the  middle  of  the 
achievement  range  for  the  total  Alberta  high  school  population. ^ 
None  of  the  students  had  markedly  superior  scores  or  markedly 
inferior  scores. 

Table  IX,  page  56,  indicates  that  there  is  a  wide  variation 
in  aptitudes  of  the  students  as  measured  by  the  D.A.T.  Some 

i 

students  made  markedly  superior  scores  while  others  made  markedly 
inferior  scores  on  each  D.A.T.  subtest,  except  for  the  N.A.  Suptest 
where  there  were  no  markedly  inferior  scores. 


^"Alberta  Department  of  Education  "Promotion  Practices  Report, 
Grades  X,  XI  and  XII u  (Edmonton:  Testing  and  Research  Office,  1965), 
(Mimeographed ). 
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II.  NULL  HYPOTHESIS  AND  ZERO  ORDER  CORRELATIONS 

Null  Hypothesis  One  states : 

There  is  no  significant  correlation  at  the  .05  level  of  sig¬ 
nificance  between  each  of  Language  10  and  20  average,  Social  Studies 
10  and  20  average,  Mathematics  10  and  20  or  12  and  22  average,  Science 
10  and  20  average,  average  of  Mathematics  10  or  12,  Mathematics  20 
or  22,  Science  10,  Science  20,  and: 

la*  relative  success  to  the  end  of  Year  A  of  the  N.A.I.T. 
three  year  Electronics  program. 

i 

lb.  relative  success  to  the  end  of  Year  B  of  the  N.A.I.T. 
three  year  Electronics  program. 

lc.  relative  success  to  the  end  of  Year  C.  of  the  N.A.I.T. 

three  year  Electronics  program.  > 

Table  X  on  page  61  consists  of  the  correlations  pertinent  to 
Hypothesis  One  and  Table  XI  on  page  62  is  a  summary  of  the  results 
for  the  hypothesis. 

Null  Hypothesis  Two  states : 

There  is  no  significant  correlation  at  the  .05  level  of 
significance  between  each  of  the  grade  IX  predictor  variables 
(XI  -  X9)  and: 

2ac  relative  success  to  the  end  of  Year  A  of  the  N.A.I.T. 
three  year  Electronics  program. 

2b.  relative  success  to  the  end  of  Year  B  of  the  N.A.I.T. 
three  year  Electronics  program. 

2c.  relative  success  to  the  end  of  Year  C  of  the  N.A.I.T. 
three  year  Electronics  program. 

Table  XII  on  page  63  consists  of  the  correlations  pertinent  to 
Hypothesis  Two  and  Table  XIII  on  page  64  is  a  summary  of  the  results 
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for  the  hypothesis. 


Null  Hypothesis  Three  s t at e s  : 


There  is  no  significant  correlation  at  the  *05  level  of  sig¬ 


nificance  between  the  grade  9  academic  average,  (X23  ~  XI  1-  X2  -f-  X3  •+ 

6 


X4  -f  X5  1  X6)  the  grade  10  and  11  academic  average  (X24  =  X10  H-  Xll  -f 


4 


X12  4  X13 )  and: 

3a,  relative  success  to  the  end  of  Year  A  of  the  N.A.I.T. 
three  year  Electronics  program0 

3b.  relative  success  to  the  end  of  Year  B  of  the  N.A.I.T, 
three  year  Electronics  program. 

3c.  relative  success  to  the  end  of  Year  C  of  the  N.A.I.T. 
three  year  Electronics  program. 

Table  XIV  on  page  65  consists  of  the  correlations  pertinent  to 
Hypothesis  Three  and  Table  XV  on  page  66  is  a  summary  of  the  results 
for  the  hypothesis. 

Null  Hypothesis  Four  states : 

There  is  no  significant  correlation  at  the  .05  level  between 
each  of  the  D.A.T.  subtest  scores  (X14  -  X22),  and: 

4a.  relative  success  to  the  end  of  Year  A  of  the  N.A.I.T. 
three  year  Electronics  program. 

4b.  relative  success  to  the  end  of  Year  B  of  the  N.A.I.T. 
three  year  Electronics  program. 

4c.  relative  success  to  the  end  of  Year  C  of  the  N.A.I.T. 
three  year  Electronics  program. 

Table  XVI  on  page  67  consists  of  the  correlations  pertinent  to 
Hypothesis  Four  and  Table  XVII  on  page  69  is  a  summary  of  the  results 


for  the  hypothesis. 


. 


• 

60. 


Null  Hypothes is  Five  states 

Ther*e  is  no  significant  correlation  at  the  .05  level  of  sig¬ 


nificance  between: 

5a.  relative  success  to  the  end  of  Year  A  (Yl),  of  the  N.A.I.T. 
three  year  Electronics  program  and  relative  success  to  the 
end  of  Year  B  (Y2)  of  the  N.A.T.T.  three  year  Electronics 
program, 

5b.  relative  success  to  the  end  of  Year  A  (Yl),  of  the  N.A.I.T. 
three  year  Electronics  program  and  relative  success  to  the 
end  of  Year  C  (Y3),  of  the  N.A.I.T.  three  year  Electronics 
program. 

5c.  relative  success  to  the  end  of  Year  B  (Y2),  of  the  N.A.I.T. 
three  year  Electronics  program  and  relative  success  to  the 
end  of  Year  C  (Y3),  of  the  N.A.I.T.  three  year  Electronics 
program. 

The  data  in  Table  XVIII,  page  71,  indicates  that  Null  Hypothesis 


5a,  5b  and  5c  can  be  rejected  at  the  .05  level  of  confidence  for  all 


samples. 


Table  XIX,  page  72,  is  a  summary  of  criterion  inter correlations 


for  those  who  remained  in  the  program  over  its  entire  length.  The 
criterion  intercorrelations  indicate  a  fairly  high  degree  of  relation¬ 
ship  between  relative  performance  in  the  different  years  of  the  pro¬ 
gram.  The  criterion  intercorrelations  on  Table  XIX  are  somewhat 
lower  than  those  shown  on  Table  XVIII.  A  major  reason  for  this  is 


that,  according  to  the  relative  success  definition,  students  who 
dropped  out  during  one  year  of  the  program  automatically  were  assigned 
the  same  criterion  score  for  subsequent  years  of  the  program. 
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TABLE  XIV 

ZERO  ORDER  CORRELATIONS  BETWEEN  HIGH  SCHOOL  AVERAGES 

AND  CRITERION  SCORES 


X23 

X24 

Predictor  Variable  1 

Grade  IX  Academic 

Grade  10  and  11  Academic 

Ave. 

Ave. 

Y1 

Success  to  End 
Year  A 

Y2 

Sample  1  Success  to  End  .hO* 

(N  =  50)  Year  B 

Y3 

Success  to  End  .33 

Year  C 


Y1 

Success  to  End  #52* 

Year  A 

Y2 

Sample  2  Success  to  End  .32 

(N  =  46)  Year  B 

Y3 

Success  to  End  • 3^* 

Year  C 


Only  r's  that  are  significant  at  the  .05  level  were  printed. 
See  Appendix  A  for  complete  correlation  matrix* 

*  denotes  significance  at  the  ,01  level 
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III.  REGRESSION  EQUATIONS 


Regression  equations  were  arrived  at  by  means  of  the  Reg.  300 
Stepwise  Multiple  Linear  Regression  computer  program,  with  signifi¬ 
cance  levels  for  variables  entering  and  leaving  each  equation  being 
set  at  the  .05  level.  All  the  regression  equations  produced  by  the 
computer  for  predicting  criterion  scores  on  the  basis  of  sample  1 
data  are  listed  in  Table  XX,  page  75. 

The  seven  regression  equations  produced  in  the  Reg.  300  process 
were  then  cross-validated  on  the  data  from  sample  2,  Table  XXI, 
page  76,  is  a  summary  of  the  results  of  the  cross  validation. 

Upon  cross  validation,  equation  B  was  found  to  be  the  best, 
having  not  only  the  highest  shrunken  R  with  Yl,  the  criterion 
variable  for  which  is  was  calculated,  but  also  the  highest  correlations 
with  Y2  and  Y3  from  sample  2.  Equation  F  was  selected  as  being  the 
second  best  equation  in  that  it  had  the  second  best  correlation  with 
Y3  from  sample  2,  and  in  that  it  included  only  2  predictor  variables  ver¬ 
sus  3  for  equation  C. 

For  the  two  selected  combinations  of  variables,  X13  with  X17 

(from  equation  B),  and  X12  and  X13  (from  equation  F),  the  optimum 

Beta  weights  for  predicting  each  of  the  3  criterion  variables  for 

2 

sample  1  were  calculated  using  the  method  outlined  by  Ferguson.  ' 


2Gsorge  A.  Ferguson,  Statistical  Analysi 
Education,  Edition  2,  (McGraw  Hill  Book  Co. ,  N 


New  York:  1966),  pp. 390-394 


is  in  Psychology  and 


. 


.  ' 


' 
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Equation  B1  Y1  =  0.514  X13  +  0.286  X17  -4.0 

Equation  B2  Y2  =  0.457  X13  +  0.233  X17  +3.9 


Equation  B3  Y3  =  0.286  X13  +  0.240  X17  +  13.4 


Equation  FI  Y1  =  0.541  X12  +  0.532  X13  -  12.3 
Equation  F2  Y2  =  0.574  X12  +  0.443  X13  -  9.2 
Equation  F3  Y3  =  0.519  X12  +  0.278  X13  +  3.7 


The  zero  order  correlations  between  sample  2  criteria  and  the 
regression  scores  calculated  on  the  basis  of  equations  B1  -  F3  were 
then  found.  Table  XXII,  page  77  is  a  summary  of  those  correlations. 
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TABLE  XXII 

CORRELATIONS  BETWEEN  SELECTED  REGRESSION  EQUATIONS  WITH  OPTIMUM 

v 

BETA  WEIGHTS  CALCULATED  FOP.  SAMPLE  1  AND  CRITERION  VARIABLES  FOR 

SAMPLE  ONE  AND  SAMPLE  TWO 


Equation 

Sample  1  N 

-  50 

Sample 

2  N  = 

46 

Y1 

Y2 

Y3 

Y1 

Y2 

Y3 

B1 

.61 

.51 

.43 

.62 

.40 

.43 

B2 

.59 

.51 

.42 

.62 

.40 

.43 

B3 

.59 

.50 

.43 

.61 

.39 

.42 

FI 

.57 

.54 

.44 

.40 

.32* 

.40 

F2 

.57 

.55 

.45 

.49 

.31* 

.40 

F3 

.55 

.54 

.45 

.47 

.29* 

.39 

**  Indicates  significance  at  the  .05  level.  All  other 
correlations  significant  at  the  .01  level. 

The  combination  of  X17  and  X13  (Equation  B)  are  shown  to  be 
superior  to  the  combinations  of  X12  and  X13  (Equation  F)  for  pre¬ 
diction  of  relative  success  to  the  end  of  Year  A  of  the  three  year 
Electronics  program.  However,  the  two  combinations  are  shown  to 
be  equally  effective  for  prediction  of  relative  success  to  the  end 
of  the  program  (Y3). 

Por  the  purpose  of  counselling  the  student  as  to  what  level 
of  relative  success  he  can  expect  over  the  length  of  the  progiam, 
the  criterion  variable  Y3  is  the  most  important.  Also,  the  high 
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school  math  and  science  grades  are  available  before  the  student 
enters  the  program.  Therefore,  the  combination  of  high  school 
math  and  physical  science  grades  was  selected  as  the  optimum 
predictor. 

The  data  in  Table  XXII  indicates  that  there  is  little  to 

choose  between  the  trial  Beta  weights.  Also  the  math-science. 

average  (X25),  was  found  to  correlate  with  Y3  as  well  as  the 

3 

regression  combinations  of  the  same  variables.' 

Therefore  expectancy  tables  were  based  on  the  math-science 
average  with  a  Beta  weight  of  1. 

The  regression  equations  produced  on  the  basis  of  sample  3 
data,  in  the  steps  of  the  Reg.  300  Stepwise  Multiple  Linear  Regres¬ 
sion  procedure,  are  listed  in  Table  XXIII,  on  the  following  page. 


^See  Table  X,  page  6l 
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TABLE  XXIII 

REGRESSION  EQUATIONS  FOR  SAMPLE  3 
PRODUCED  BY  REG.  300  N  =  76 


Equation 

Designation 

R 

P  Probabil- 
R  ity  Level 

H 

Y1  =  0. 2 88  X17 

+  26.268 

0.40 

0.159  .000365 

I 

Y2  =  0. 263  X17 

+  28.403 

O.36 

0.132  .001249 

J 

Y2  =  0.334  X17 

-  0.106  X21  +  29.243 

0.42 

0.179  .000743 

K 

Y3  =  0. 264  X17 

+  28.420 

0.36 

0.133  .000760 

L 

Y3  =  0.339  X17 

-  .104  X21  +  29.251 

0.42 

0.179  .000760 

Significance  level  for  variables  entering  and  leaving  =  0.03 

The  regression  equations  developed  on  the  basis  of  data  from 
sample  3  were  then  cross-validated  on  the  data  from  sample  4.  The 
results  of  the  cross-validation  procedure  are  summarized  in  Table  XXIV 
on  the  following  page. 


TABLE  XXIV 
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CROSS-VALIDATION  OF  REGRESSION  EQUATIONS  FROM  SAMPLE  THREE  ON  THE 

DATA  FROM  SAMPLE  FOUR 


Equation 

Multiple  Correlation  with 
Criterion  Variable  from 
Sample  3  (N  =  76) 

Zero  Order  Correlation  with 
Criterion  Variables  from 
Sample  4  (N  =  56) 

Y1 

Y2 

Y3 

Y1  Y2  Y3  ' 

H 

.40 

.32 

I  &  K 

(identical ) 

.36 

.36 

.32 

J 

.42 

L 

.42 

• 

All  multiple  R's  significant  at  .01  level 

Only  zero  order  correlations  with  sample  4  criteria  significant 
at  the  .05  level  were  printed. 


The  data  in  Table  XXIV  indicates  that  none  of  the  regression 
equations  developed  for  sample  3  data  were  significant  at  the  .05 
level  for  predicting  relative  success  to  the  ends  of  Years  B  and 
C  for  sample  4. 


. 
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IV.  EXPECTANCY  TABLES  ■ 

TABLE  XXV 

EXPECTANCY  TABLE  FOR  ALBERTA  NON-ADULT  STUDENTS  ENTERING  THE  N.A.I.T. 

THREE  YEAR  ELECTRONICS  PROGRAM 


Math-Science 
Average  % 

Number 

Graduated 

Number 

Failed 

Totals 

75  -  79 

1 

0 

1 

70-74  * 

4 

0 

4 

65  -  69 

4 

4 

8 

60  -  64 

15 

3 

18 

55  -  59 

15 

21 

36 

50  -  54 

8 

21 

29 

Totals 

47 

49 

96 

based  on  emperical  data  from  those  students  who  entered  the 
three,  year  Electronics  program  in  1965  and  in  1966. 

includes  those  students  who  obtained  their  post  grade  £  high 
school  training  in  Alberta  and  who  wrote  Grade  IX  Department als  within 
6  years  of  entering  the  N.A.I.T.  program 

Students  who  withdrew  from  the  N.A.I.T.  program  with  an  average 
in  their  last  quarter  of  greater  than  55#  and  who  failed  no  courses 
in  their  last  quarter  were  not  included. 

Math-science  average  equals  average  of  final  grades  (%)  in 
math  10  or  12,  math  20  or  22,  science  10  and  science  20. 
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See  Appendix  B  for  sample  calculations. 
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CHAPTER  V 


83. 

SUMMARY,  DISCUSSION  AND  CONCLUSIONS  AND 
RECOMMENDATIONS 

I.  SUMMARY,  DISCUSSION  AND  CONCLUSIONS 

The  purpose  of  this  study  was  to  obtain  information  which 
could  be  useful  for  the  prediction  of  relative  success  in  the 
NoA.I.T.  three  year  Electronics  program,  to  provide  some  descript¬ 
ive  statistics  as  to  the  nature  of  the  students  who  entered  the 
program  in  1965  and  1966  with  respect  to  high  school  achievement 
scores  and  aptitude  measures,  and  to  provide  some  information  as 
to  the  stability  of  relative  performance  over  the  length  of  the 
N.A.I.T.  three  year  Electronics  program.  An  attempt  was  made  to 
find  useful  predictor  combinations  from  the  D.A.T.  subtest  scores 
for  the  total  groups  which  entered  the  program,  and  also  to  find 
useful  predictor  combinations  from  Alberta  Grade  IX  Departmental 
Examination  scores,  Alberta  Grade  10  and  11  academic  course  grades, 
and  the  D.A.T.  subtest  scores,  for  those  Alberta  non-adult  students 
entering  the  program.  Alberta  non-adult  students  were  defined  as 
those  students  who  had  written  their  Alberta  Grade  IX  Departmental 
Examinations  within  six  years  of  entering  the  program  and  who  had 
obtained  their  grade  10  and  11  schooling  in  Alberta.  The  total 
group  included,  in  addition  to  Alberta  non— adult  students,  Alberta 
adult  students  and  non-Alberta  students. 

Sample  3  consisted  of  those  76  students  who  entered  the 
program  in  1965,  for  whom  complete  predictor  data  was  available. 
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and  who  did  not  withdraw  for  reasons  other  than  poor  achievement. 
Sample  1  consisted  of  the  50  Alberta  non-adult  students  who  were 
included  in  sample  3,  Sample  4  consisted  of  those  56  students 
who  entered  the  program  in  1966  and  who  met  the  same  conditions 
as  those  listed  for  sample  3®  Sample  2  consisted  of  the  46  Alberta 
non-adult  students  included  in  sample  4. 

Criterion  scores  were  relative  success  (T  scores,  mean  50, 
standard  deviation  10)  to  the  end  of  each  of  the  three  years  of 
the  Electronics  program.  Relative  success  was  defined  as  rank  in 
class  based  on  the  weighted  average  of  final  grades  in  that  year 
of  the  program  under  consideration.  Students  who  dropped  out  be¬ 
fore  the  end  of  that  year  were  ranked  below  those  who  did  not  drop 
out,  according  to  length  of  time  in  the  program.  Students  who 
dropped  out  in  the  same  quarter  were  ranked  according  to  weighted 
average  in  the  last  complete  quarter. 

Means,  standard  deviations  and  ranges  of  predictor  variables 
were  determined  and  tabulated.1  The  level  of  achievement  of  the 
Alberta  non— adult  students  in  the  Grades  IX,  X  and  XI  academic 
courses  was  found  to  be  centered  very  closely  around  the  middle 

2 

achievement  range  for  the  total  Alberta  high  school  population. 

^See  Tables  VII  -  IX,  pages  54  -  56. 

^Alberta  Department  of  Education  "Promotion  Practices  Report, 
Grades  X,  XI  and  XII"  (Edmonton:  Testing  and  Research  Office,  1965), 
(Mimeographed.  ) 


L 


■ 


■ 


InJSS 


85. 


None  of  the  students  had  markedly  superior  scores  or  markedly 

inferior  scores.  The  Grade  IX  Departmental  Examination  scores 

were  found  to  be  considerably  lower  than  those  of  the  students 

3 

in  Black’s  study  on  the  relationship  between  Grade  IX  results  and 
university  freshman  success,  where  the  averages  tended  to  lie  between 
75  and  80$. 

The  admission  requirements  for  the  Electronics  program  (67 
high  school  credits  and  50^  or  better  in  Mathematics  20  or  22), 
may  be  part  of  the  reason  why  there  were  no  markedly  inferior 
academic  scores. 

The  results  of  the  D.A.T.  battery  indicated  a  wide  variation 
in  the  aptitudes  of  the  students.  Some  students  made  markedly 
superior  scores  while  others  made  markedly  inferior  scores  on  each 
D.A.T.  subtest,  except  for  the  Numerical  Ability  subtest  in  vdiich 
no  markedly  inferior  scores  were  recorded.  Students  in  all  four 
samples  achieved  the  best  average  on  the  D.A.T.  Numerical  Ability 
subtest,  with  the  next  three  highest  scores  being  achieved  on  the 
Mechanic  Reasoning,  Abstract  Reasoning  and  Verbal  Reasoning  plus 
Numerical  Ability  subtests. 

Average  scores  on  the  above  mentioned  D.A.T.  subtests  were 

^Donald  B.  Black,  ’’The  Prediction  of  University  Freshman 
Success  Using  Grade  IX  Departmental  Scores,"  Alberta  Journal  of 
Educational  Research,  Vol.  5,  No.  4,  1959,  pp.  229  -  239. 
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considerably  above  the  fiftieth  percentile  point.  However,  ob- 
servations  regarding  the  superiority  or  inferiority  of  the 
samples  should  be  made  with  caution,  as  the  norms  used  were  based 
on  the  results  for  Grade  12  students  in  the  U.S.A. 

In  comparing  sample  1  with  sample  3,  and  sample  2  with 
sample  4,  no  marked  difference  in  D.A.T.  subtest  means  was  found 
to  be  evident.  This  would  indicate  that  non-Alberta  and  adult 
students  in  the  samples  were  not  markedly  different  from  the 
Alberta  non-adult  students  with  respect  to  aptitudes  as  measured 
by  the  D.A.T. 

Caution  should  be  exercised  in  comparing  the  D.A.T.  results 
for  samples  1  and  3  with  the  results  for  samples  2  and  4,  as  diff¬ 
erent  forms  of  the  D.A.T.  were  administered  to  the  two  pairs  of 
samples,  and  they  we re  administered  at  points  3  months  apart  in 
the  Electronics  program. 

Zero  order  correlations  between  all  predictor  variables  and 
all  criterion  variables  were  determined  and  tabulated.^  For  Alberta 
non-adult  students,  the  high  school  math-science  average  was  found 
to  be  the  most  significant  and  consistent  predictor  of  relative 
success  over  the  length  of  the  three  year  Electronics  program. 

See  Tables  X,  XII,  XIV,  XV I  and  Appendix  A. 
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The  math-science  average  was  found  to  be  a  significant  (.05  level) 
predictor  of  relative  success  to  the  ends  of  each  of  the  three  years 
of  the  Electronics  program  for  each  of  two  independent  samples.  The 
high  school  academic  average  was  also  found  to  be  a  consistently 
significant  (.05  level)  predictor  of  relative  success  to  the  end 
of  each  of  the  three  years  of  the  Electronics  program  for  each  of 
two  independent  samples.  However,  the  correlations  between  crit¬ 
erion  scores  and  the  academic  average  were  found  to  be  lower  than 
those  between  criterion  scores  and  math-science  average. 

The  high  school  math  average,  high  school  science  average 
and  D.A.T.  Numerical  Ability  scores  were  also  found  to  be  fairly  good 
predictors  of  relative  success  in  the  Electronics  program.  However, 
they  were  not  found  to  be  significant  (.05  level)  consistently  enough 
to  warrant  their  use  in  counselling  without  further  investigation. 

Language  grades,  S.C.A.T.  scores,  grade  IX  academic  average 
and  the  remainder  of  the  D.A.T.  subtest  scores  were  found  to  be  of 
little  value  as  predictors  of  success  in  the  Electronics  program. 

The  fact  that  the  high  school  math-science  average  was  found 
to  be  the  best  single  predictor  of  relative  success  in  the  N.A.I.T. 
three  year  Electronics  program  is  in  agreement  with  Geiss’^  conclusion 
► 

^Almon  Lewis  Geiss,  "An  Analysis  of  Relationships  Between  Courses 
Taken  in  High  School  and  Success  in  Specific  areas  at  the  Oregon  Tech¬ 
nical  Institute",  Doctoral  Dissertation,  (Washington  State  University, 
1966),  and  Ann  Arbor,  Michigan,  University  Microfilms,  1966,  p.  96. 
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that  physics,  mathematics  and  chemistry  correlated  most  highly 
with  success  in  engineering  technologies  at  the  Oregon  Technical 
Institute. 

Price's^  finding  that  the  Lorge  Thorndike  Intelligence 
test  was  of  little  value  for  predicting  first  quarter  weighted 
average  in  the  N.A.I.T.  Electronics  program  appears  to  be  in 
agreement  with  the  findings  of  this  study  in  that  S.C.A.T.  scores 
and  the  D.A.T.  general  intelligence  measure  (Verbal  Reasoning  plus 
Numerical  Ability)  were  not  found  to  be  good  predictors  of  relative 
success  in  the  same  program.  This  would  indicate  that  general  in- 
telligence  measures  are  likely  to  be  of  little  value  as  predictors 
of  success  in  Electronics  at  N.A.I.T.,  at  least  for  those  students 
who  have  achieved  to  the  level  of  present  admission  requirements. 

The  fact  that  grade  IX  Reading,  Literature  and  Language,  high 
school  Language,  and  D.A.T.  Verbal,  Spelling,  and  Sentences  were  not 
found  to  be  significant  predictors  (.05  level)  of  any  of  the  crit¬ 
erion  scores  for  any  of  the  samples  indicates  that  success  in  the 
N.A.I.T.  Electronics  program  has  little  dependence  on  verbal  factors, 
at  least  not  at  the  ability  levels  of  the  students  who  have  achieved  to 
the  level  of  present  admission  requirements. 

^Donald  W.  Price,  "Predictive  Validity  of  the  D.A.T.  Subtest 
Scores  and  the  Lorge  Thorndike  Subtest  Scores  on  Year  A  Students  at 
N.A.I.T."  (Unpublished  Institutional  Study,  Northern  Alberta  Instit¬ 
ute  of  Technology,  Edmonton,  1967),  p.  7. 
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For  the  samples  which  included  adult  and  non-Alberta  stud¬ 
ents  (samples  3  and  4)  the  D.A.T.  Numerical  Ability  subtest  was 
found  to  have  the  highest  average  correlation  with  criterion 
scores.  However,  the  correlations  between  Numerical  ability  scores 
and  relative  success  to  the  end  of  each  of  the  three  years  of  the 
Electronics  program  were  found  to  be  lower  for  sample  3  than  for 
sample  1,  and  lower  for  sample  4  than  for  sample  2.  Sample  1 
consisted  of  the  non-adult  Alberta  students  in  sample  3*  and 
sample  2  consisted  of  the  non-adult  Alberta  students  in  sample  4. 

This  result  would  therefore  seem  to  indicate  that  the  relative 
success  of  adults  and/or  non-Alberta  students  in  Electronics  is 
not  as  predictable  by  means  of  the  D.A.T.  Numerical  ability 
subtest  as  is  the  relative  success  of  non-adult  Alberta  students. 

I.ntercorrelations  between  criterion  scores  for  each  of  the 
four  samples,  and  for  those  in  each  of  the  four  samples  who  remained 

7 

in  the  program  over  its  entire  length  were  determined  and  tabulated. 

A  high  degree  of  relationship  was  found  between  relative 
success  to  the  ends  of  each  of  the  three  years  of  the  N.A.I.T, 
Electronics  program.  Sample  2  had  the  lowest  criterion  inter corre¬ 
lations,  with  first  year  relative  success  accounting  for  30/  of 


^See  Tables  XVIII  and  XIX,  pages  71  -  72, 
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the  variance  in  relative  success  to  the  end  of  third  year. 

The  criterion  intercorrelations  for  the  samples  are  useful 
as  an  indication  of  how  well  a  student  will  do  in  later  years  of 
the  program  compared  to  the  groups  with  which  he  entered  the  pro¬ 
gram.  However,  a  more  meaningful  measure  of  the  stability  of  rel¬ 
ative  performance  in  different  years  of  the  program  is  provided  by 
criterion  intercorrelations  for  those  students  who  remained  in  the 
program  over  its  entire  length. 

The  criterion  intercorrelations  for  each  of  the  four  sub- 

g 

groups  who  remained  in  the  program  over  its  entire  length  were 
found  to  be  significant  at  the  .05  level  in  all  cases.  Group  2a 
wras  found  to  be  the  least  stable,  where  Year  A  relative  success 
accounted  for  17$  of  the  variance  in  relative  success  to  the  end  of 
Year  C.  For  this  group  the  correlation  between  relative  success 
to  the  end  of  Year  A  and  relative  success  to  the  end  of  Year  C 
(r  —  0.42)  is  in  the  same  order  of  magnitude  as  that  reported  by 
Evanson  and  Smith  for  correlation  between  first  and  third  year 
university  average  (r  =  0.45),  of  students  graduating  from  the 


^For  definition  of  groups,  see  page  13« 

^A.  B.  Evanson  and  D.  E.  Smith,  "A  Study  of  Matriculation  in 
Alberta,”  Alberta  Journal  of  Educational  Research,  Vol.  4,  No.  2, 
1957,  p.  70. 
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University  of  Alberta  in  three  years. 

For  groups  1,  3  and  4  the  correlations  between  relative 
success  to  the  end  of  Year  A  and  relative  success  to  the  end  of 
Year  C  were  found  to  be  0,76,  0,79,  and  0,79  respectively.  These 
correlations  are  in  the  same  order  of  magnitude  as  the  median 
intercorrelations  between  college  grades  in  adjacent  semesters 
(median  r  ~  0,79)  and  higher  than  those  for  college  grades  3 
semesters  apart  (median  r  —  0,66),  reported  by  Bloom^  for  a. 

group  of  American  colleges, 

< 

The  data  therefore  indicates  that  relative  performance 
over  the  length  of  the  N.A.I.T.  three  year  Electronics  program  is 
at  least  as  stable  as  the  performance  of  college  students  from  one 
year  to  the  next. 

The  criterion  intercorrelations  for  group  3a  were  greater  than 
those  for  subgroup  la  in  each  of  the  3  corresponding  cases,  and  the 
criterion  intercorrelations  for  group  4a  were  found  to  be  higher 
than  those  for  group  2a  in  each  of  the  3  corresponding  cases.  Group 
la  consists  of  the  Alberta  non-adult  students  in  group  3a  and  group 
2a  consists  of  the  Alberta  non-adult  students  in  group  4a,  The 
data,  therefore  indicates  that  the  relative  performance  of  adult 
and/or  non-Alberta  students  is  more  stable  over  the  length  of  the 

"^Benjamin  S.  Bloom  and  Frank  R.  Peters,  "The  Use  of  Academic 
Prediction  Scales  for  Counselling  and  Selecting  College  Entrants" 

The  Free  Press  of  Glenco,  New  York:  1961),  p.  37. 
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Electronics  program  than  is  the  relative  performance  of  Alberta 
non-adults. 

However,  considering  the  small  numbers  of  the  different  cat¬ 
egories  of  students  included  in  each  of  the  groups,  the  result 
regarding  the  relative  stability  of  performance  of  the  different  cat¬ 
egories  of  students  should  not  be  considered  definitive  without 
confirmation  by  further  study. 

A  stepwise  multiple  linear  regression  procedure  was  used  to 
establish  predictor  equations  on  the  basis  of  the  data  from  the 
samples  of  the  group  which  entered  the  program  in  1965.  The  regres¬ 
sion  equations  were  cross-validated  on  the  data  from  the  samples 
of  the  group  which  entered  the  program  in  1966, 

For  Alberta  non-adult  students  (sample  1)  a  number  of  the 
regression  equations  were  found  to  have  higher  correlations  with 
criterion  scores  than  any  of  the  individual  predictors  that  were 
tested.  When  the  regression  equations  for  the  data  from  sample  1 
were  cross -validated  on  the  data  from  sample  2,  the  regression 
scores  for  most  of  the  equations  were  found  to  have  lower  correlations 
with  the  sample  2  criterion  scores  than  did  the  high  school  math- 
science  average.  Two  exceptions  were  a  regression  combination  of 
D.A.T.  Numerical  Ability  and  high  school  Science,  and  a  regression 
combination  of  high  school  Math  and  high  school  Science. 

The  regression  combination  of  D.A.T.  Numerical  Ability  and 
high  school  Science  was  found  to  have  the  highest  average  corre- 
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lation  with  criterion  scores  for  sample  1  and  for  sample  2,  How¬ 
ever,  the  regression  equation  was  not  found  to  be  superior  to  the 
high  school  math-science  average  as  a  predictor  of  relative  success 
to  the  end  of  the  third  year  of  the  program.  The  regression  combin¬ 
ation  of  high  school  Math  and  high  school  Science  also  was  not 
found  to  be  superior  to  the  math-science  average  as  a  predictor 
of  relative  success  to  the  end  of  the  third  year  of  the  program. 

The  shrinkage  of  the  correlation  coefficients  upon  cross- 

validation  of  the  regression  equations,  to  the  point  where  the 

regression  equations  were  very  little  better  than  math-science 

average  as  predictors  of  relative  success,  is  in  close  agreement 

1]  12 

with  the  findings  of  Wessman  and  Bennet.  They  concluded  that 
a  simple  average  is  often  found  to  be  as  effective  a  predictor 
as  a  regression  combination  of  the  predictor  scores  when  the  re¬ 
gression  equations  are  cross-validated. 

For  the  samples  which  included  adult  and  non-Alberta  stud¬ 
ents  the  problem  of  shrinkage  of  correlation  coefficients  when 
the  regression  equations  were  cross-validated  was  more  serious 
than  for  the  Alberta  non-adult  samples.  For  sample  3,  regression 
equations  based  on  D.A.T.  scores  we re  found  to  have  significant 


^A.  E.  Wessman  and  G.  K.  Bennet,  "Multiple  Regression  vs. 

Simple  Addition  of  Scores  in  Prediction  of  College  Grades,"  Educational 
and  Psychological  Measurement,  Vol,  XIX,  No.  2,  1959,  p.  243~246. 

~^Ibid. ,  p.  245 
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correlations  (.01  level)  with  each  of  the  criterion  scores.  When 
these  equations  were  cross-validated  on  the  data  from  sample  4, 
none  of  the  regression  equations  were  found  to  be  significant 
(.05  level)  predictors  of  relative  success  to  the  end  of  the 
second  year  of  the  program,  or  to  the  end  of  the  third  year  of 

13 

the  program. 

This  result  tends  to  confirm  Mosier’s  contention  that,  if  the 
combining  weights  of  a  predictor  composite  are  determined  on  one 
sample,  the  effectiveness  of  the  composite  must  be  determined  on 
another  independent  sample.  4  Travers  7  also  suggested  that,  when 
multiple  correlation  techniques  are  used,  cross-validation  should 
be  carried  out . 

The  results  of  one  of  Black’s  ^  studies  appear  to  be  at 
some  variance  v/ith  the  results  of  this  study  regarding  shrinkage 

13See  Table  XXIII  and  Table  XXIV,  pp.  79  -  80. 

■^Charles  I.  Hosier,  "Problems  and  Designs  of  Cross-Validation," 
Educational  and  Psychological  Measurement,  Vol.  II,  No.  1,  1951,  p.  6. 

15 

Robert  M.  Travers,  An  Introduction  To  Educational  Research. 
(Mew  York:  The  MacMillan  Co.,  1964), "p.  379. 

"^Donald  B.  Black,  "Validity  of  Regression  Equations  After 
Six  Years  to  Predict  Freshman  Success  in  Engineering, "  Alberta 
Journal  of  Educational  Research,  Vol.  10,  No.  1,  1964,  pp.  125  -  136. 
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of  correlation  coefficients.  Black  found  that,  when  a  regression 
equation  developed  for  predicting  freshman  success  in  Engineering 
at  the  University  of  Alberta  was  applied  to  a  similar  group  of 

engineering  freshman  six  years  later,  the  shrinkage  of  the  come- 
lation  coefficient  was  not  significant. 

One  of  the  reasons  for  the  difference  in  shrinkage  may  be 

18 

that  Black  used  considerably  larger  samples  (validation  sample, 

N  =  529).  The  use  of  larger  samples  may  reduce  the  error  due  to 
fitting  for  accidental  characteristics  of  the  sample.  Larger  samples 
are  not  possible  in  the  case  of  the  N.A.I.T.  three  year  Electronics 
program,  due  to  the  limitation  imposed  by  the  relatively  small 
enrollment . 

It  was  concluded  that  the  results  of  this  study  should  not 
be  used  for  counselling  adult  and  non-Alberta  prospective  Electronics 
students  as  to  expected  level  of  performance  over  the  length  of  the 
N.A.I.T.  three  year  Electronics  program.  This  conclusion  was  based 
on  the  following  findings: 

1.  None  of  the  regression  equations  developed  on  the  basis 
of  sample  3  data  were  found  to  be  significant  predictors 
of  relative  success  to  the  end  of  the  program  for 
sample  4. 


17 Ibid. 

18  •  J 

Ibid . 

19See  Table  XXIII  and  Table  XXIV,  pp.  79  -  80. 


1 

' 


. 

* 


\ 


. 


96. 


2.  None  of  the  D.A.T.  subtexts  were  found  to  be  consis¬ 
tently  significant  predictors  of  relative  success  over 

20 

the  length  of  the  program  for  both  sample  3  and  sample  4. 

It  was  concluded  that  the  results  of  this  study  would  be  of 
value  for  counselling  Alberta  non-adult,  prospective  Electronics 
students  as  to  expected  level  of  relative  performance  over  the  length 
of  the  N. A.I.T.  three  year  program.  This  conclusion  was  drawn  on 
the  basis  that  a  number  of  predictors  were  found  to  have  significant 
(.05  level)1  correlations  with  relative  success  to  the  ends  of  each 
of  the  three  years  of  the  Electronics  program  for  each  of  two 
independent  samples. 

The  correlation  between  high  school  math-science  average  and 

relative  success  to  the  end  of  the  third  year  of  the  N. A.I.T. 

Electronics  program  was  found  to  be  0.44  for  the  case  of  sample  1,  and 

21 

0.40  in  the  case  of  sample  2.  These  correlations  are  in  the 

22 

same  order  of  magnitude  as  those  reported  by  Evanson  and  Smith  '  for 
the  relationship  bet ween  the  grade  XII  average  and  the  average  in  the 
graduating  year  at  the  University  of  Alberta,  The  grade  XII  average 
is  used  as  one  of  the  main  criteria  for  admission  to  the  University  of 
Alberta. 


20 


See  Table  XVI,  p 
^See  Table  X,  p. 
^^E van s on ,  op.  cit 
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The  high  school  math-science  average  was  selected  as  the 
optimum  predictor  of  relative  success  in  the  N.A.I.T.  three  year 
Electronics  program.  The  reasons  are  listed  below: 

1.  The  math-science  average  was  found  to  be  a  consistently 
significant  (.05  level)  predictor  of  relative  success 
over  the  length  of  the  program. 

2.  Though  the  math-science  average  was  found  to  have  a 

Tower  correlation  with  relative  success  to  the  end  of 

the  first  year  of  the  Electronics  program  than  did  a 

regression  combination  of  D.A.T.  Numerical  Ability  and 

Science  average,  and  a  regression  combination  of  Math 

23 

average  and  Science  average,  the  correlation  of  the 
math-science  average  with  relative  success  to  the  end 
of  the  third  year  of  the  program  was  as  high  as  that 
of  either  of  the  regression  equations.  As  the  pros¬ 
pective  student  would  be  most  interested  in  his  rel¬ 
ative  success  pos5.tion  to  the  end  of  the  program,  the 
lower  correlation  with  success  at  the  beginning  of  the 
program  was  not  considered  serious. 

3.  The  student  would  usually  know  his  math-science  average 
some  months  before  having  to  make  a  final  decision 

23 


See  Table  XXII,  p.  77. 
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regarding  entrance  into  the  N.A.I.T.  Electronics  pro¬ 
gram. 

4.  The  simple  average  is  more  easily  calculated  than  are 
regression  scores. 

2Zi 

Expectancy  tables  were  constructed,  using  the  high  school 
math-science  average  as  the  predictor  of  relative  success  to  the 
end  of  the  third  year  of  the  N.A.I.T.  Electronics  program.  These 
tables  should  be  of  value  for  assisting  the  prospective  Electronics 
student  in  making  a  decision  regarding  entrance  into  the  program. 
However,  a  number  of  limitations  should  be  kept  in  mind  when  apply¬ 
ing  this  data  to  the  decision  making  situation. 

1.  Information  which  applies  to  a  group  as  a  whole  does  not 
necessarily  apply  to  any  given  individual.  There  are 
always  exceptions. 

2.  No  attempt  was  made  to  include  psychological  and  sociol¬ 
ogical  factors  in  the  prediction  study.  Students  who 
withdrew  from  the  program  with  an  average  of  at  least  55$ 
in  their  last  quarter  and  who  failed  no  courses  in  their 
final  quarter  were  excluded  from  the  samples.  Therefore, 
no  claim  is  made  to  validity  of  results  of  this  study 
for  predicting  withdrawals . 

3.  The  study  was  carried  out  on  the  basis  of  samples  taken 
from  the  groups  which  entered  N.A.I.T.  in  1965  and  1966. 


24 


See  Table  XXV  and  Table  XXVI,  pp.  81  -  82. 
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Since  that  time  changes  have  taken  place  in  high  school 
math  and  science  courses,  and  in  some  of  the  courses 
of  the  N.A.I.T.  Electronics  program.  These  changes 
may  affect  the  validity  of  the  results  of  this  study. 

4.  The  expectancy  tables  were  based  on  data  from  samples 
consisting  of  Alberta  non-adult  students.  They  should 
not  be  used  for  adult  students  or  non-Alberta  students. 

5.  All  of  the  students  in  the  samples  had  math-science  av¬ 
erages  which  fell  between  50$  and  80$,  Therefore,  appli¬ 
cation  of  the  results  of  this  study  to  those  students 
whose  math-science  average  does  not  fall  within  that 
range  would  be  risky. 

6.  Only  one  female  entered  the  N.A.I.T.  three  year  Electronics 
program  in  1965  and  1966e  Therefore,  the  results  of  this 
study  may  not  apply  to  females. 

7.  The  correlation  between  math-science  average  and  relative 
success  to  the  end  of  the  program,  while  significant,  ac¬ 
counts  for  only  17$  of  the  variance  in  that  criterion 
score.  Therefore  a  large  portion  of  the  variance  in 
relative  success  to  the  end  of  the  N.A.I.T.  three  year 
Electronics  program  is  accounted  for  by  factors  not  taken 
into  account  in  this  study. 

8.  This  study  was  concerned  with  prediction  of  success  in  a 
particular  Electronics  program0  Predictors  of  success  in 
a'  training  program  are  not  necessarily  valid  predictors  of 
success  on  the  job0 
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III.  RECOMMENDATIONS  AND  IMPLICATIONS  FOR  FURTHER  STUDY 

1.  If  the  results  of  this  study  are  to  be  used  for  counsel¬ 
ling  purposes,  consideration  should  be  given  to  obtain¬ 
ing  high  school  math  and  science  grades  in  multiples  of 
5%,  rather  than  the  customary  letter  gradings,  as  there 
is  considerable  difference  between  the  expected  perform¬ 
ance  of  students  with  a  math-science  average  at  the  lower 
end  of  the  B  letter  grading  and  of  students  with  a  math- 
science  average  at  the  upper  end  of  the  B  letter  grading, 

2.  It  may  be  of  value  to  carry  out  a  validity  generalization 
study  on  the  results  of  this  study  for  predicting  rel¬ 
ative  success  in  the  N. A.I.T.  two  year  Electronics  program. 

3.  Further  work  on  establishing  N. A.I.T.  norms  for  the  D.A.T. 
subtests  may  improve  the  predictive  validity  of  the  sub¬ 
test  scores. 

4.  Credit  in  high  school,  physical  science  is  not  a  prerequi¬ 
site  for  entrance  into  the  N. A.I.T.  three  year  Electronics 
program.  A  study  of  the  success  of  students  who  enter  the 
program  without  physical  science  credits  may  be  of  value. 

5.  The  high  school  physical  science  course  in  Alberta  has 
been  split  inlo  physics  and  chemistry  courses,  and  the 
mathematics  course  in  the  high  school  has  undergone  some 
changes  since  the  students  in  the  samples  entered  the 

N. A.I.T.  Electronics  program.  In  addition,  some  courses 
in  the  Electronics  program  have  undergone  changes.  The 
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effect  of  these  changes  on  the  validity  of  the  results 
of  this  study  should  be  investigated  before  they  are 
used. 

6.  An  investigation  of  the  predictive  validity  of  standard¬ 
ized  tests  of  science  background  or  science  aptitude  may 
be  of  some  value,  especially  for  non-Alberta  or  adult 


students. 
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CORRELATION  MATRIX  FOR  SAMPLE  1  N  =  50 


XI  X2 

X3 

X4 

X5 

X6 

X7 

X8 

X9 

X10 

XI 

1.00  .33 

.40 

.25 

-.03 

.40 

.69 

.79 

.28 

.41 

X2 

1.00 

.20 

.16 

-•13 

.23 

.31 

.42 

.08 

•  44 

X3 

1.00 

.21 

-.16 

.26 

.24 

.39 

-.02 

.33 

X4 

1.00 

.22 

.42 

.33 

.30 

.13 

.24 

X5 

1.00 

.35 

.22 

.00 

.42 

-.03 

X6 

1.00 

.46 

.45 

.24 

.47 

X7 

1.00 

.  86 

.59 

.36 

X8 

1.00 

.29 

.43 

X9 

1.00 

.09 

X10  1.00 

XU 

X12 

X13 

X14 

X15 

X16 

X17 

X18 

X19 

X20 
X21 
X22  ‘ 

Yl 

Y2 

Y3 
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Xll 

X12 

X13 

X14 

X15 

X16 

X17 

X18 

XI 9 

X20 

XI 

.14 

-.06 

.07 

.18 

-.09 

.41 

.15 

.20 

.50 

.20 

X2 

.30 

.00 

.05 

-.04 

-.04 

.15 

.21 

.25 

.33 

-.10 

X3 

.17 

-.29 

.01 

-.16 

.03 

.09 

-.06 

.29 

.30 

-.07 

X4 

.25 

.16 

.22 

-.08 

.03 

.26 

.23 

.03 

.11 

.06 

X5 

-.21 

.32 

.17 

.28 

.18 

.30 

.38 

-.25 

.06 

.30 

X6 

.22 

.02 

.28 

-.05 

.08 

.60 

.05 

-.02 

.23 

.24 

X7 

.19 

.06 

.19 

.32 

.02 

.52 

.45 

.29 

.44 

.39 

X8 

.19 

-;o6 

.11 

.16 

.01 

.46 

.21 

.33 

.53 

.24 

X9 

-.10 

.25 

.08 

.40 

.00 

.41 

.51 

.12 

.23 

.35 

X10 

.42 

.04 

.30 

.00 

-.10 

.22 

.27 

.21 

.16 

.18 

Xll 

1.00 

.04 

.48 

-016 

-.04 

.14 

.21 

.22 

.10 

.12 

X12 

1.00 

.23 

.39 

.13 

.14 

•  42 

-.29 

-.09 

.26 

X13 

1.00 

-.13 

.02 

.21 

.23 

„06 

-.04 

.12 

X14 

1.00 

.02 

.43 

.54 

-.14 

.12 

.62 

X15 

1.00 

.08 

.08 

-.08 

-.19 

.03 

X16 

1.00 

.26 

-.14 

.27 

.63 

X17 

1.00 

-.01 

.19 

.38 

X18 

1.00 

.42 

-.15 

X19  1.00  .14 

X20  l-*00 

X21 

X22 

Y1 

Y2 

Y3 
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X21  X22 


XI 

.56 

.  48 

X2 

.32 

.35 

13 

.39 

.24 

X4 

.11 

.18 

15 

.05 

.21 

X6 

.21 

.20 

17 

.67 

.71 

IS 

.67 

.61 

X9 

.31 

.47 

X10 

.27 

.33 

Xll 

.06 

.15 

X12 

.05 

.24 

X13 

.06 

.17 

X14 

.26 

.43 

X15 

-.12 

-.04 

Xl6 

.29 

.35 

X17 

.30 

.67 

X18 

.30 

.21 

X19 

.58 

.51 

X20 

.31 

.40 

X21 

1.00 

.87 

122 

1.00 

Y1 

Y2 

Y3 


Y1 

Y2 

Y3 

.06 

-.07 

-.05 

.00 

-.02 

-.02 

-.12 

-.21 

-.21 

.09 

-.03 

-.08 

.39 

.32 

.32 

.19 

.09 

.09 

.21 

.09 

.05 

.06 

-.04 

-.07 

.22 

.23 

.3.7 

.14 

.10 

.07 

.27 

.19 

.17 

.45 

.46 

.41 

.45 

.40 

.28 

to 

• 

.28 

.36 

.14 

.09 

.12 

.29 

.10 

.12 

.49 

.41 

.39 

-.17 

-.16 

-.17 

0"\ 

o 

. 

i 

-.09 

-.07 

.33 

.16 

.22 

.01 

-.08 

-.08 

.25 

.16 

.15 

1.00 

.87 

.85 

1.00 

.93 

1.00 

r* 
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CORRELATION  MATRIX  FOR  SAMPLE  2  N  =  A 6 


XI 

X2 

X3 

X4 

X5 

XI 

1.00 

.61 

.35 

.33 

o 

o 

• 

X2 

1.00 

.58 

.42 

.19 

X3 

1.00 

.02 

.14 

X4 

1.00 

.35 

X5 

1.00 

X6 

X7 

X8 

X9 

XIO 

Xll 

X12 

XI 3 

X14 

XI 5 

Xl6 

X17 

X18 

X19 

X20 

X21 

X22 

Y1 

Y2 

Y3 


X6  X7  X8  X9  XIO 


.42 

.69 

.77 

.13 

.17 

.49 

.63 

.64 

.22 

.19 

.15 

.47 

.34 

.26 

.02 

CO 

-vO 

. 

.32 

.37 

.10 

.13 

.49 

.39 

.05 

.68 

.10 

1.00 

.51 

•  46 

.33 

.16 

1.00 

.81 

.58 

.17 

lo00 

.07 

.22 

1.00 

.09 

1.00 


• 

X 
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Xll 

X12 

X13 

X14 

X15 

XI 6 

X17 

X18 

X19 

XI 

.13 

-.27 

-.16 

.17 

.00 

.35 

-.03 

.35 

.27 

X2 

.14 

-.02 

-.06 

.18 

.19 

.20 

.08 

.40 

.39 

X3 

-.17 

.10 

-.12 

.2 4 

.14 

.17 

.06 

.24 

.56 

X4 

.60 

.08 

.29 

.07 

.25 

.01 

-.03 

.19 

.16 

X5 

.13 

.27 

.29 

.10 

.06 

-.04 

.14 

.21 

.10 

X6 

.40 

.07 

.18 

.06 

•  23. 

.16 

-.10 

.17 

.23 

X7 

.08 

i 

-.05 

.01 

.21 

-.03 

.21 

.16 

.45 

.40 

X8 

.21 

-.20 

-.07 

.10 

-.04 

.25 

.01 

.28 

.37 

X9 

-.04 

.22 

.17 

.22 

.05 

.02 

.27 

.40 

.10 

X10 

.21 

.03 

.17 

-.00 

.24 

-.04 

.07 

.00 

.14 

Xll 

1.00 

.12 

.45 

-.22 

.18 

-.09 

.06 

.00 

.13 

X12 

loOO 

.  55 

.18 

.13 

-.27 

•  24 

.17 

-.09 

X13 

1.00 

.12 

.08 

-.19 

.25 

.10 

.04 

X14 

1.00 

.15 

.31 

-.01 

.33 

.11 

XI 5 

1.00 

.27 

.16 

.10 

.05 

XI 6 

1.00 

.01 

-.14 

.16 

X17 

1.00 

.06 

-.04 

X18 

1,00 

.16 

1.00 


X20 

X21 

X22 

n 

Y2 

Y3 


» 
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X20  X21 


XI 

.15 

.57 

X2 

.03 

.40 

X3 

.20 

.29 

X4 

-.02 

.18 

X5 

.24 

.06 

X6 

.07 

.21 

X7 

.36 

.56 

X8 

.14 

.55 

X9 

.39 

.24 

X10 

-.02 

.04 

Xll 

>-.11 

.21 

X12 

.17 

-.17 

X13 

.14 

.03 

X14 

.50 

.39 

X15 

.07 

-.01 

X16 

„3S 

.42 

X17 

.34' 

.03 

X18 

-.02 

.32 

X19 

.17 

.45 

X20 

1.00 

.29 

X21 

1.00 

X22 

Y1 

Y2 

Y3 


X22 

Y1 

Y2 

Y3 

.59 

-.04 

-.10 

-.03 

.52 

.04 

.03 

.12 

.43 

.01 

.05 

.13 

.24 

.33 

.33 

.41 

.11 

.31 

.18 

.23 

.23 

.21 

.09 

.15 

.70 

.15 

-.05 

.00 

.64 

.13 

.04 

.01 

.32 

.18 

.02 

.04 

.11 

.22 

-.07 

-.06 

.21 

.34 

.40 

.41 

-.12 

.38 

.22 

o33 

.07 

.50 

.34 

.38 

0  29 

.17 

-.13 

-.04 

.01 

.21 

.05 

.11 

.38 

.05 

-.03 

-.05 

.38 

.49 

.29 

.30 

.28 

.04 

.03 

.12 

.47 

.16 

.19 

.20 

.41 

.32 

.09 

.10 

•  84 

.19 

.11 

.12 

1.00 

.30 

.16 

.17 

1.00 

.69 

.71 

1.00 

.93 

1.00 
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CORRELATION  MATRIX  FOR  SAMPLE  3  N  =  76 


X14 

XI 5 

Xl6 

X17 

X18 

X19 

X20 

X21 

X22 

Y1 

Y2 

Y3 

X14 

1.00 

.01 

.41 

.57 

-.04 

.21 

.62 

.36 

.23 

.34 

.27 

.31 

X15 

1.00 

.01 

.02 

-.11 

-.21 

.01 

-.04 

.16 

.02 

! 

• 

O 

M 

.01 

X16 

1.00 

.26 

-.07 

.36 

.52 

.30 

-.02 

.  23 

.14 

.15 

X17 

1.00 

.07 

.23 

.40 

.41 

.20 

.40 

.36 

.36 

X18 

loGO 

.42 

-.09 

.27 

-.32 

.02 

.01 

.00 

X19 

1.00 

.20 

.52 

-.09 

.10 

.06 

.06 

X20 

. 

1.00 

o 

<r\ 

o 

.20 

.29 

.21 

.23 

X21 

1.00 

.07 

.02 

-.05 

-.05 

X22 

loOO 

.19 

.19 

.21 

Y1 

1.00 

.42 

.90 

Y2 

1.00 

.97 

Y3 

1.00 
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CORRELATION 

MATRIX 

FOR 

SAMPLE 

4  N  = 

56 

X14 

X15 

X16 

X17 

X18 

XI 9 

X20 

X21 

X22 

Y1 

Y2 

Y3 

X14 

1.00 

.29 

.36 

.14 

.41 

.20 

.46 

.39 

.35 

.16 

-.05 

.00 

X15 

loOO 

.34 

o  24 

o  20 

.12 

.17 

.09 

.14 

.31 

.18 

.23 

X16 

IcOO 

.09 

-olO 

.19 

.44 

0  44 

.41 

.19 

.09 

.08 

X17 

1.00 

ol6 

.02 

.25 

.15 

.50 

.32 

.17 

.20 

X18 

1.00 

o25 

-.02 

.34 

.33 

.03 

.01 

.06 

X19 

1.00 

.17 

.41 

.42 

.14 

.16 

.18 

X20 

loOO 

.29 

.35 

.  44 

.26 

.27 

X21 

1.00 

.86 

.21 

.09 

.10 

X22 

1.00 

.23 

.07 

.09 

Y1 

1.00 

.97 

.79 

Y2 

l.CO 

.97 

Y3 

1.00 

* 
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SAMPLE  CALCULATIONS 


SAMPLE  CALCULATION  OF  T  SCORE 
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Student,  designated  number  132  from  sample  2  (N  =  46,  dropped 
out  during  the  5th  quarter  after  obtaining  a  weighted  average  of 
39.6$  in  quarter  4. 

number  of  people  from  sample  2  in  program  after  5  quarters  —  23 
number  of  people  who  dropped  out  at  the  end  of  quarter 
5  or  who  obtained  an  average  of  greater  than  39.6$  in 


quarter  4 .  8 

rank  in  class  -  student  number  132 .  32 

rank  in  class  from  the  bottom  =  46-32  —  14 

percentile  rank  in  class  ==  100  (rank  -.5)^  —  100  (14  -.5)  =  29.4 

N  ~  46 

percentile  points  below  the  median . .  20.6 

2 

standard  score  . . . . . =  - 

T  score  =  50  +  (standard  score)  10  =  50  -.54X10  =  45 


This  T  score  will  be  the  same  for  relative  success  to  the  end 
of  Year  B  and  to  the  end  of  Year  C. 


X George  A.  Ferguson,  Statistical  Analysis  in  Psychology  and 
Education,  (McGraw-Hill  Book  Company,  New  York:  1966)  p,  259. 


2Ibid.  t  Table  A,  p.  402 
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SAMPLE  CALCULATIONS  FOR  EXPECTANCY  TABLE  XXVI 
Expected  T  score  for  relative  success  -  Beta  weight  x  math-science 


to  the  end  of  Year  C  (Y3) 

Avec,  (X15)  -  C 

Beta  weight-^  =  1 

math  science  average  for  sample  1  and  sample  2 . =  57.7 

therefore  constant . . . =  -7.7 


regression  equation,  Y3  —  X25  -7.7 

given  that  X25  equals  60.5  for  a  particular  student 


Y3  =  60.5  -7.7 . . . . . . . -  52.8 

standard  score  =  52. 8  -  50 . =  +0.28 

10 

expected  percentile  rank^  —  50  +  (.1103)  x  100 . =  61 

c  _ _  _ 

standard  error  of  estimate  =  Sy  )  1-r  =10)  1-.42"  =  7.6 

chances  are  2  in  3  that  T  score  =  53  +  7.6 . =  45.4  -  60,4 

T  score  45.2  =  standard  score  =  -4 . 8  =  -.48 

10 

standard  score  of  -.48  equals  percentile  rank^  50-(.1844)  100  =  32 

similarly  a  T  score  of  60o4  —  standard  score  -f-1.02 

=  percentile  rank . .  85 


3c 

See  page 

^Ferguson,  op.  cit. ,  p.  402 
5 Ibid. ,  p.  126. 

6Ibid. ,  p.  402 
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standard  errors  of  estimate  above  50  $  tile  point  =  208  =  .355 

7 . 6 

area  of  normal  curve  between  50  $  tile  point  and  standard 

score  of  .355  is  (14  )7  100 . . . -  14$ 

therefore  chances  of  achieving  at  least  50$tile  — 

50$  +  14$. . . . =  64$ 

A  similar  calculation  for  chances  of  reaching  75%  tile 

point  yields  chances  of  being  in  top  J  of  class . =  30$ 


Therefore  a  student  with  a  math  science  average  of  60.5$  is 
most  likely  to  be  at  the  61$  tile  with  respect  to  relative  success 
to  the  end  of  Year  C  of  the  three  year  Electronics  program  at 
N.A.I.T. ,  has  a  2  in  3  chance  of  being  between  32-85$  tile  points  has 
a  64$  chance  of  being  in  the  top  half  of  the  class  and  a  30$  chance  of 
being  in  the  top  quarter  of  the  class » 


. 

^  X 


